2024-08-17T02:12:47.962 INFO:root:teuthology version: 1.2.0 2024-08-17T02:12:47.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:12:48.076 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858276' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDsanbEflKTSakTQ5yzpdS4ecksFFukDLyKEi18v2LKtsSna9ogWI9vK5NOR70+b6jeaxNz4uPs1KSzRE0LuXTg= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8Lo80LPJRKNuvei7/EzJGaBsRqOejqvFQ86LIzcmH83UBKhvN1IicAOFmJxARF1p7PIWW3IMT3zJN6mmQ+KBc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:12:48.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:12:48.077 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:12:48.077 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:12:48.079 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:12:48.100 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:12:48.101 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:12:48.101 INFO:teuthology.packaging:ref: None 2024-08-17T02:12:48.101 INFO:teuthology.packaging:tag: None 2024-08-17T02:12:48.101 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:48.101 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:12:48.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:48.243 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:12:48.244 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:12:48.249 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:12:48.250 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:12:48.281 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:12:48.297 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:12:48.304 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:12:48.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:58.368694', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDsanbEflKTSakTQ5yzpdS4ecksFFukDLyKEi18v2LKtsSna9ogWI9vK5NOR70+b6jeaxNz4uPs1KSzRE0LuXTg='} 2024-08-17T02:12:48.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:58.366994', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8Lo80LPJRKNuvei7/EzJGaBsRqOejqvFQ86LIzcmH83UBKhvN1IicAOFmJxARF1p7PIWW3IMT3zJN6mmQ+KBc='} 2024-08-17T02:12:48.345 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:12:48.351 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:12:48.354 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:12:48.354 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:12:48.405 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f247866bac0>, signals=[15]) 2024-08-17T02:12:48.405 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:12:48.410 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:12:48.410 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:12:48.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:48.487 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:12:48.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:48.560 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:12:48.566 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-08-17T02:12:48.585 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-08-17T02:12:48.585 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-08-17T02:12:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-08-17T02:12:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-08-17T02:12:48.642 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:12:48.643 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:12:48.644 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-08-17T02:12:48.664 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-08-17T02:12:48.681 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-08-17T02:12:48.681 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-08-17T02:12:48.737 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-08-17T02:12:48.737 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:12:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:12:48.739 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-08-17T02:12:48.756 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:12:48.766 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:12:48.772 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:12:48.772 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:48.774 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:48.793 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:12:48.800 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:12:48.800 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:48.832 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:48.922 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:12:48.972 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:12:48.986 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:12:48.987 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:12:48.987 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:12:48.987 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:48.988 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:49.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:49.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:12:49.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:49.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:12:49.164 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:49.164 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:12:49.165 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-08-17T02:12:49.166 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:49.166 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:12:49.166 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-08-17T02:12:49.182 INFO:teuthology.orchestra.run.smithi150.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:12:49.183 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:49.183 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:12:49.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum upgrade -y linux-firmware 2024-08-17T02:12:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:12:49.185 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:49.185 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:12:49.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum upgrade -y linux-firmware 2024-08-17T02:12:51.606 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-08-17T02:12:53.709 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-08-17T02:12:54.440 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-17T02:12:56.835 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-08-17T02:12:58.840 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-17T02:13:00.474 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 18 kB 00:00 2024-08-17T02:13:01.428 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-17T02:13:01.444 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.6 MB 00:00 2024-08-17T02:13:03.112 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 18 kB 00:00 2024-08-17T02:13:03.981 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-17T02:13:06.976 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-17T02:13:09.012 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:13:09.028 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-08-17T02:13:09.029 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-08-17T02:13:09.029 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 1 Package 2024-08-17T02:13:09.029 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:13:09.029 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 383 M 2024-08-17T02:13:09.029 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-08-17T02:13:09.381 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-17T02:13:11.467 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-08-17T02:13:11.477 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-08-17T02:13:11.477 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:11.477 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-08-17T02:13:11.477 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 1 Package 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:13:11.478 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 383 M 2024-08-17T02:13:11.479 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-08-17T02:13:16.674 INFO:teuthology.orchestra.run.smithi146.stdout:linux-firmware-20240716-145.el9.noarch.rpm 75 MB/s | 383 MB 00:05 2024-08-17T02:13:16.674 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:16.674 INFO:teuthology.orchestra.run.smithi146.stdout:Total 74 MB/s | 383 MB 00:05 2024-08-17T02:13:19.535 INFO:teuthology.orchestra.run.smithi150.stdout:linux-firmware-20240716-145.el9.noarch.rpm 37 MB/s | 383 MB 00:10 2024-08-17T02:13:19.536 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:19.536 INFO:teuthology.orchestra.run.smithi150.stdout:Total 36 MB/s | 383 MB 00:10 2024-08-17T02:13:19.768 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-08-17T02:13:19.860 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-08-17T02:13:19.860 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-08-17T02:13:22.637 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-08-17T02:13:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-08-17T02:13:22.706 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-08-17T02:13:23.166 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-08-17T02:13:23.166 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-08-17T02:13:25.957 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-08-17T02:13:25.957 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-08-17T02:13:32.187 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-08-17T02:13:32.993 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:33.081 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:33.938 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:33.938 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:34.658 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:34.658 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:13:34.658 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-08-17T02:13:34.658 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:13:34.658 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:13:34.659 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-08-17T02:13:34.998 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:13:34.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:35.147 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:13:35.148 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:13:35.151 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2024-08-17T02:13:35.873 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-08-17T02:13:36.210 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:36.301 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:36.971 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:36.971 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:13:37.694 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-08-17T02:13:38.046 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:13:38.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:38.185 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:13:38.185 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:13:38.187 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi150.front.sepia.ceph.com to complete... 2024-08-17T02:13:49.082 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17 02:13:49 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:13:49.082 INFO:teuthology.orchestra.run.smithi150.stderr:FINISHED --2024-08-17 02:13:49-- 2024-08-17T02:13:49.082 INFO:teuthology.orchestra.run.smithi150.stderr:Total wall clock time: 11s 2024-08-17T02:13:49.082 INFO:teuthology.orchestra.run.smithi150.stderr:Downloaded: 1 files, 344M in 11s (32.5 MB/s) 2024-08-17T02:13:49.086 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:13:49.086 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:13:51.148 INFO:teuthology.orchestra.run.smithi150.stdout:Verifying... ######################################## 2024-08-17T02:13:51.280 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing... ######################################## 2024-08-17T02:13:51.331 INFO:teuthology.orchestra.run.smithi150.stdout:Updating / installing... 2024-08-17T02:13:59.398 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:14:39.851 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:14:39.851 DEBUG:teuthology.orchestra.run.smithi150:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:39.932 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:39.932 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:39.932 INFO:teuthology.orchestra.run.smithi150.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:14:39.933 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:14:39.934 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:14:39.935 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:14:39.936 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:14:39.937 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:14:39.938 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:14:39.939 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:14:39.940 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:14:39.941 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:14:39.942 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:14:39.943 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:14:39.944 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:14:39.945 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:14:39.946 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:14:39.947 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:14:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:14:39.949 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:14:39.950 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:14:39.951 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:14:39.952 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:14:39.953 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:14:39.954 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:14:39.955 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:14:39.956 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:14:39.957 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:14:39.958 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:14:39.959 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:14:39.960 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:14:39.961 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:14:39.962 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:14:39.963 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:14:39.964 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:14:39.965 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:14:39.966 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:14:39.967 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:14:39.968 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:14:39.969 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:14:39.970 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:14:39.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:14:39.973 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:14:39.974 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:14:39.975 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:14:39.976 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:14:39.977 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:14:39.978 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:14:39.979 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:14:39.980 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:14:39.981 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:14:39.982 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:14:39.983 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:14:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:14:39.985 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:14:39.986 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:14:39.987 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:14:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:14:39.989 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:14:39.990 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:14:39.991 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:14:39.992 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:14:39.993 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:14:39.994 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:14:39.995 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:14:39.996 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:14:39.997 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:14:39.998 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:14:39.999 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:14:40.000 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:14:40.001 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:14:40.002 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:14:40.003 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:14:40.004 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:14:40.005 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:14:40.006 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:14:40.007 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:14:40.008 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:14:40.009 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:14:40.010 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:14:40.011 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:14:40.012 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:14:40.013 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:14:40.014 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:14:40.015 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:14:40.016 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:14:40.017 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:14:40.018 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:14:40.019 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:14:40.020 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:14:40.021 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:14:40.022 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:14:40.023 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:14:40.024 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:14:40.025 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:14:40.026 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:14:40.027 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:14:40.028 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:14:40.029 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:14:40.030 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:14:40.031 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:14:40.032 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:14:40.033 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:14:40.034 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:14:40.035 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:14:40.036 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:14:40.037 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:14:40.038 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:14:40.039 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:14:40.040 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:14:40.041 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:14:40.042 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:14:40.043 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:14:40.044 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:14:40.045 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:14:40.046 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:14:40.047 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:14:40.048 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:14:40.049 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:14:40.050 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:14:40.051 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:14:40.052 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:14:40.053 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:14:40.054 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:14:40.055 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:14:40.056 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:14:40.057 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:14:40.058 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:14:40.059 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:14:40.060 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:14:40.061 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:14:40.062 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:14:40.063 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:14:40.064 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:14:40.065 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:14:40.066 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:14:40.067 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:14:40.068 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:14:40.069 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:14:40.070 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:14:40.071 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:14:40.072 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:14:40.073 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:14:40.074 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:14:40.075 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:14:40.076 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:14:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:14:40.078 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:14:40.079 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:14:40.080 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:14:40.081 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:14:40.082 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:14:40.083 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:14:40.084 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:14:40.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:14:40.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:14:40.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:14:40.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:14:40.085 INFO:teuthology.orchestra.run.smithi150.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:40.089 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:40.089 DEBUG:teuthology.orchestra.run.smithi150:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:40.112 INFO:teuthology.orchestra.run.smithi150.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: fi 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:40.114 INFO:teuthology.orchestra.run.smithi150.stdout:fi 2024-08-17T02:14:40.115 DEBUG:teuthology.orchestra.run.smithi150:> sudo rpm -qi grub2-tools 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Name : grub2-tools 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Epoch : 1 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Version : 2.06 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Release : 68.el9 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: x86_64 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Group : Unspecified 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:Size : 8264254 2024-08-17T02:14:40.191 INFO:teuthology.orchestra.run.smithi150.stdout:License : GPLv3+ 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Packager : builder@centos.org 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Vendor : CentOS 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Summary : Support tools for GRUB. 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:Description : 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:14:40.192 INFO:teuthology.orchestra.run.smithi150.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:14:40.193 INFO:teuthology.orchestra.run.smithi150.stdout:hardware devices. 2024-08-17T02:14:40.193 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:14:40.193 INFO:teuthology.orchestra.run.smithi150.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:14:40.193 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:14:40.194 INFO:teuthology.task.kernel:Updating grub on smithi150 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:40.194 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:14:40.763 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-08-17T02:14:42.118 INFO:teuthology.orchestra.run.smithi150.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:14:42.148 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-08-17T02:14:42.150 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-08-17T02:14:42.166 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.NSASSScJlj 2024-08-17T02:14:42.166 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NSASSScJlj 2024-08-17T02:14:42.231 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.NSASSScJlj 2024-08-17T02:14:42.377 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.NSASSScJlj is 6KB 2024-08-17T02:14:42.407 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.NSASSScJlj 2024-08-17T02:14:42.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:14:42.490 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:14:42.490 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:14:42.490 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:14:42.491 INFO:teuthology.orchestra.run.smithi150.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:14:42.492 DEBUG:teuthology.orchestra.run.smithi150:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:42.631 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-08-17T02:14:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17 02:14:54 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:14:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2024-08-17 02:14:54-- 2024-08-17T02:14:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 1m 19s 2024-08-17T02:14:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 344M in 1m 18s (4.38 MB/s) 2024-08-17T02:14:54.182 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:14:54.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:14:56.251 INFO:teuthology.orchestra.run.smithi146.stdout:Verifying... ######################################## 2024-08-17T02:14:56.314 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing... ######################################## 2024-08-17T02:14:56.367 INFO:teuthology.orchestra.run.smithi146.stdout:Updating / installing... 2024-08-17T02:15:04.434 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:12.634 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:15:12.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:15:12.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:31.039 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-08-17T02:15:40.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:15:40.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:42.631 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:15:42.632 DEBUG:teuthology.orchestra.run.smithi146:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:15:42.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:15:42.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:15:42.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:15:42.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:15:42.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:15:42.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:15:42.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:15:42.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:15:42.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:15:42.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:15:42.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:15:42.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:15:42.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:15:42.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:15:42.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:15:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:15:42.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:15:42.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:15:42.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:15:42.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:15:42.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:15:42.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:15:42.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:15:42.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:15:42.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:15:42.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:15:42.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:15:42.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:15:42.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:15:42.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:15:42.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:15:42.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:15:42.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:15:42.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:15:42.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:15:42.771 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:15:42.772 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:15:42.773 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:15:42.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:15:42.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:15:42.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:15:42.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:15:42.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:15:42.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:15:42.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:15:42.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:15:42.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:15:42.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:15:42.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:15:42.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:15:42.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:15:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:15:42.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:15:42.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:15:42.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:15:42.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:15:42.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:15:42.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:15:42.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:15:42.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:15:42.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:15:42.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:15:42.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:15:42.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:15:42.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:15:42.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:15:42.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:15:42.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:15:42.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:15:42.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:15:42.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:15:42.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:15:42.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:15:42.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:15:42.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:15:42.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:15:42.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:15:42.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:15:42.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:15:42.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:15:42.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:15:42.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:15:42.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:15:42.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:15:42.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:15:42.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:15:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:15:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:15:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:15:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:15:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:15:42.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:15:42.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:15:42.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:15:42.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:15:42.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:15:42.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:15:42.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:15:42.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:15:42.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:15:42.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:15:42.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:15:42.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:15:42.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:15:42.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:15:42.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:15:42.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:15:42.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:15:42.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:15:42.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:15:42.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:15:42.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:15:42.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:15:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:15:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:15:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:15:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:15:42.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:15:42.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:15:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:15:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:15:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:15:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:15:42.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:15:42.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:15:42.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:15:42.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:15:42.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:15:42.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:15:42.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:15:42.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:15:42.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:15:42.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:15:42.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:15:42.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:15:42.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:15:42.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:15:42.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:15:42.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:15:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:15:42.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:15:42.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:15:42.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:15:42.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:15:42.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:15:42.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:15:42.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:15:42.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:15:42.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:15:42.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:15:42.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:15:42.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:15:42.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:15:42.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:15:42.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:15:42.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:15:42.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:15:42.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:15:42.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:15:42.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:15:42.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:15:42.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:15:42.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:15:42.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:15:42.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:15:42.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:15:42.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:15:42.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:15:42.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:15:42.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:15:42.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:15:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:15:42.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:15:42.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:15:42.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:15:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:15:42.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:15:42.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:15:42.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:15:42.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:15:42.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:15:42.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:15:42.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:15:42.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:15:42.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:15:42.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:15:42.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:15:42.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:15:42.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:15:42.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:15:42.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:15:42.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:15:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:15:42.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:15:42.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:15:42.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:15:42.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:15:42.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:15:42.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:15:42.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:15:42.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:15:42.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:15:42.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:15:42.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:15:42.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:42.912 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.912 DEBUG:teuthology.orchestra.run.smithi146:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:42.935 INFO:teuthology.orchestra.run.smithi146.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:15:42.935 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:42.935 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:42.935 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-08-17T02:15:42.935 INFO:teuthology.orchestra.run.smithi146.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: fi 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:done 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-08-17T02:15:42.937 INFO:teuthology.orchestra.run.smithi146.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:15:42.937 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:42.937 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:42.937 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2024-08-17T02:15:42.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-08-17T02:15:43.011 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 68.el9 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8264254 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-08-17T02:15:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:15:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-08-17T02:15:43.014 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:15:43.014 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:15:43.014 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:15:43.015 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:43.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:15:43.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-08-17T02:15:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-08-17T02:15:45.005 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:15:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-08-17T02:15:45.036 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-08-17T02:15:45.051 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.p2kv54lYvM 2024-08-17T02:15:45.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.p2kv54lYvM 2024-08-17T02:15:45.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.p2kv54lYvM 2024-08-17T02:15:45.254 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.p2kv54lYvM is 6KB 2024-08-17T02:15:45.303 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.p2kv54lYvM 2024-08-17T02:15:45.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:15:45.379 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:15:45.380 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:15:45.380 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:15:45.380 INFO:teuthology.orchestra.run.smithi146.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:15:45.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:45.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-08-17T02:15:55.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:15:55.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:13.535 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-08-17T02:16:15.543 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:16:15.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:16:15.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:28.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:16:28.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:28.925 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-08-17T02:16:29.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:16:29.493 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:16:29.494 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-08-17T02:16:29.527 INFO:teuthology.orchestra.run.smithi150.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:29.528 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:29.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:29.528 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:16:30.529 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:34.016 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-08-17T02:16:43.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:16:43.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:46.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-08-17T02:16:58.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:16:58.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:16.511 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-08-17T02:17:31.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:17:31.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:33.765 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-08-17T02:17:34.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:17:34.310 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:17:34.311 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-08-17T02:17:34.345 INFO:teuthology.orchestra.run.smithi146.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:34.346 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:34.346 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:17:34.346 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:17:35.349 DEBUG:teuthology.parallel:result is None 2024-08-17T02:17:35.349 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:17:35.357 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:17:35.358 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:17:35.362 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:17:35.404 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:17:35.412 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:17:35.419 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:17:35.420 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:17:35.437 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:17:35.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:17:35.504 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:17:35.504 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:17:35.518 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:17:35.662 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:35.674 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:35.698 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:35.728 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:17:35.732 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:17:35.739 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:17:35.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:17:35.743 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:17:35.800 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:17:35.810 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:17:35.810 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:17:35.814 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:17:35.849 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:35.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:36.024 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:36.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:36.163 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:17:36.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:17:36.239 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:36.301 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:17:36.392 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:36.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:17:36.526 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:17:36.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:17:36.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-08-17T02:17:36.585 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-08-17T02:17:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:17:36.707 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:17:37.069 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:17:37.077 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:17:37.078 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:17:37.092 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:17:37.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-08-17T02:17:37.228 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-08-17T02:17:37.232 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-08-17T02:17:37.311 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-08-17T02:17:37.315 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:17:37.315 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-08-17T02:17:37.353 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-08-17T02:17:37.354 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-08-17T02:17:37.391 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-08-17T02:17:37.392 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:17:37.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:17:37.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:17:37.454 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:17:37.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:17:37.512 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:17:37.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:17:37.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:17:37.688 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:17:37.698 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:17:37.711 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:17:37.712 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:23:17.708 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-08-17T02:23:17.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:23:17.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:17.808 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-08-17T02:23:17.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-08-17T02:23:17.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:23:17.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:23:18.005 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-08-17T02:23:18.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-08-17T02:23:18.121 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:23:18.130 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:23:18.131 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:18.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:18.135 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:23:18.135 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:23:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:23:18.222 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:23:18.223 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:23:18.251 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:23:18.274 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-08-17T02:23:18.299 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-08-17T02:23:18.301 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-08-17T02:23:18.325 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-08-17T02:23:18.329 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:23:18.354 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:23:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:23:18.384 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:23:18.463 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:23:18.469 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:23:18.470 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-08-17T02:23:18.470 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.470 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.470 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.470 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.486 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.492 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:23:18.494 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:23:18.502 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:23:18.503 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:23:18.503 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:23:18.503 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:23:18.511 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:23:18.511 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:23:18.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:23:18.512 DEBUG:teuthology.orchestra.run.smithi150:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:23:19.211 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:18 ago on Sat 17 Aug 2024 02:22:00 AM UTC. 2024-08-17T02:23:19.212 INFO:teuthology.orchestra.run.smithi150.stdout:Last metadata expiration check: 0:01:20 ago on Sat 17 Aug 2024 02:21:59 AM UTC. 2024-08-17T02:23:19.299 INFO:teuthology.orchestra.run.smithi146.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:23:19.302 INFO:teuthology.orchestra.run.smithi150.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:23:19.341 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-08-17T02:23:19.343 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2024-08-17T02:23:19.343 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-08-17T02:23:19.345 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-08-17T02:23:19.346 INFO:teuthology.orchestra.run.smithi150.stdout:Nothing to do. 2024-08-17T02:23:19.347 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-08-17T02:23:19.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:23:19.430 DEBUG:teuthology.orchestra.run.smithi150:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:of the main distribution, and quality may vary. 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:23:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:, 2024-08-17T02:23:19.683 INFO:teuthology.orchestra.run.smithi146.stderr:and packages are not held to any quality or security level. 2024-08-17T02:23:19.683 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:23:19.683 INFO:teuthology.orchestra.run.smithi146.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:23:19.683 INFO:teuthology.orchestra.run.smithi146.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:23:19.684 INFO:teuthology.orchestra.run.smithi150.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:23:19.684 INFO:teuthology.orchestra.run.smithi150.stderr:of the main distribution, and quality may vary. 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:, 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:and packages are not held to any quality or security level. 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:23:19.685 INFO:teuthology.orchestra.run.smithi150.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:23:19.768 INFO:teuthology.orchestra.run.smithi146.stdout:Repository successfully enabled. 2024-08-17T02:23:19.770 INFO:teuthology.orchestra.run.smithi150.stdout:Repository successfully enabled. 2024-08-17T02:23:19.812 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:23:19.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:19.818 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:23:19.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:19.958 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:23:19.958 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:23:19.962 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:23:19.962 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:23:20.091 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:23:20.092 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:23:20.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:23:20.099 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:23:20.099 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:23:20.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:23:20.148 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:23:20.149 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:23:20.155 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:23:20.155 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:23:20.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:23:20.253 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:23:20.325 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:23:20.332 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:23:20.380 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-08-17T02:23:20.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-08-17T02:23:20.388 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-08-17T02:23:20.391 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-08-17T02:23:20.666 INFO:teuthology.orchestra.run.smithi150.stdout:45 files removed 2024-08-17T02:23:20.667 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-08-17T02:23:20.699 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:23:20.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:23:21.466 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 193 kB/s | 77 kB 00:00 2024-08-17T02:23:21.510 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 174 kB/s | 77 kB 00:00 2024-08-17T02:23:21.792 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-08-17T02:23:21.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-08-17T02:23:22.117 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 6.2 kB/s | 1.8 kB 00:00 2024-08-17T02:23:22.245 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 5.6 kB/s | 1.8 kB 00:00 2024-08-17T02:23:22.343 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:23:22.570 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for el9 owned by ceph 26 kB/s | 7.6 kB 00:00 2024-08-17T02:23:22.818 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-08-17T02:23:23.287 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:23:25.829 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-17T02:23:26.788 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 20 MB 00:02 2024-08-17T02:23:31.289 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-17T02:23:31.554 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.6 MB 00:01 2024-08-17T02:23:33.090 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 18 kB 00:00 2024-08-17T02:23:33.138 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 18 kB 00:00 2024-08-17T02:23:34.201 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:23:34.378 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-17T02:23:40.440 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-17T02:23:40.750 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-17T02:23:42.961 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:23:42.961 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:23:42.972 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:23:42.973 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:23:42.974 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:23:42.974 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:23:42.976 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:23:42.978 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:23:42.979 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:23:43.039 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-08-17T02:23:43.056 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:23:43.057 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:23:43.058 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:23:43.059 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-08-17T02:23:43.060 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:23:43.061 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:23:43.062 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:23:43.063 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:23:43.064 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:23:43.065 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:23:43.066 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:23:43.067 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:23:43.068 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:23:43.068 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:23:43.068 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:23:43.068 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:23:43.068 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:23:43.069 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:======================================================================================= 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:Install 121 Packages 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 12 Packages 2024-08-17T02:23:43.070 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:23:43.071 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 206 M 2024-08-17T02:23:43.071 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-08-17T02:23:43.337 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:23:43.338 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:23:43.349 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:23:43.350 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:23:43.351 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:23:43.352 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:23:43.354 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:23:43.356 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:23:43.357 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:23:43.419 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-08-17T02:23:43.438 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-08-17T02:23:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-08-17T02:23:43.438 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-08-17T02:23:43.438 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-08-17T02:23:43.438 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:23:43.439 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:23:43.440 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:23:43.441 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:23:43.442 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:23:43.443 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:23:43.444 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:23:43.447 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:23:43.448 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:23:43.449 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:Install 121 Packages 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 12 Packages 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 206 M 2024-08-17T02:23:43.450 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-08-17T02:23:43.758 INFO:teuthology.orchestra.run.smithi150.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 39 kB/s | 6.5 kB 00:00 2024-08-17T02:23:43.942 INFO:teuthology.orchestra.run.smithi150.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.3 MB/s | 813 kB 00:00 2024-08-17T02:23:43.984 INFO:teuthology.orchestra.run.smithi146.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 35 kB/s | 6.5 kB 00:00 2024-08-17T02:23:44.042 INFO:teuthology.orchestra.run.smithi150.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.3 MB/s | 137 kB 00:00 2024-08-17T02:23:44.118 INFO:teuthology.orchestra.run.smithi150.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.4 MB/s | 5.0 MB 00:00 2024-08-17T02:23:44.229 INFO:teuthology.orchestra.run.smithi150.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 13 MB/s | 1.4 MB 00:00 2024-08-17T02:23:44.285 INFO:teuthology.orchestra.run.smithi150.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 8.6 MB/s | 2.1 MB 00:00 2024-08-17T02:23:44.444 INFO:teuthology.orchestra.run.smithi150.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 3.9 MB 00:00 2024-08-17T02:23:44.601 INFO:teuthology.orchestra.run.smithi146.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 1.3 MB/s | 813 kB 00:00 2024-08-17T02:23:44.743 INFO:teuthology.orchestra.run.smithi146.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 972 kB/s | 137 kB 00:00 2024-08-17T02:23:45.044 INFO:teuthology.orchestra.run.smithi150.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 15 MB/s | 22 MB 00:01 2024-08-17T02:23:45.094 INFO:teuthology.orchestra.run.smithi150.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 507 kB/s | 25 kB 00:00 2024-08-17T02:23:45.185 INFO:teuthology.orchestra.run.smithi146.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 4.7 MB/s | 2.1 MB 00:00 2024-08-17T02:23:45.286 INFO:teuthology.orchestra.run.smithi150.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 17 MB/s | 14 MB 00:00 2024-08-17T02:23:45.341 INFO:teuthology.orchestra.run.smithi146.stdout:(5/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 3.2 MB/s | 5.0 MB 00:01 2024-08-17T02:23:45.344 INFO:teuthology.orchestra.run.smithi150.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:23:45.460 INFO:teuthology.orchestra.run.smithi146.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 5.1 MB/s | 1.4 MB 00:00 2024-08-17T02:23:45.545 INFO:teuthology.orchestra.run.smithi150.stdout:(12/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 12 MB/s | 15 MB 00:01 2024-08-17T02:23:45.570 INFO:teuthology.orchestra.run.smithi150.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 111 kB/s | 25 kB 00:00 2024-08-17T02:23:45.603 INFO:teuthology.orchestra.run.smithi150.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 11 MB/s | 636 kB 00:00 2024-08-17T02:23:45.629 INFO:teuthology.orchestra.run.smithi150.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:23:45.654 INFO:teuthology.orchestra.run.smithi150.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:23:45.677 INFO:teuthology.orchestra.run.smithi146.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 12 MB/s | 3.9 MB 00:00 2024-08-17T02:23:45.687 INFO:teuthology.orchestra.run.smithi150.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 7.7 MB/s | 458 kB 00:00 2024-08-17T02:23:45.747 INFO:teuthology.orchestra.run.smithi150.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 771 kB/s | 45 kB 00:00 2024-08-17T02:23:45.830 INFO:teuthology.orchestra.run.smithi150.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.4 MB/s | 120 kB 00:00 2024-08-17T02:23:45.914 INFO:teuthology.orchestra.run.smithi150.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.1 MB/s | 182 kB 00:00 2024-08-17T02:23:46.022 INFO:teuthology.orchestra.run.smithi150.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 3.3 MB/s | 369 kB 00:00 2024-08-17T02:23:46.106 INFO:teuthology.orchestra.run.smithi150.stdout:(22/133): librgw2-17.2.7-1375.g2577e813.el9.x86 11 MB/s | 4.9 MB 00:00 2024-08-17T02:23:46.140 INFO:teuthology.orchestra.run.smithi150.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 2.9 MB/s | 344 kB 00:00 2024-08-17T02:23:46.182 INFO:teuthology.orchestra.run.smithi150.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.5 MB/s | 116 kB 00:00 2024-08-17T02:23:46.223 INFO:teuthology.orchestra.run.smithi150.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 982 kB/s | 82 kB 00:00 2024-08-17T02:23:46.324 INFO:teuthology.orchestra.run.smithi150.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 1.6 MB/s | 165 kB 00:00 2024-08-17T02:23:46.416 INFO:teuthology.orchestra.run.smithi150.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 265 kB/s | 24 kB 00:00 2024-08-17T02:23:46.528 INFO:teuthology.orchestra.run.smithi150.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 8.5 MB/s | 2.9 MB 00:00 2024-08-17T02:23:46.558 INFO:teuthology.orchestra.run.smithi150.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 876 kB/s | 124 kB 00:00 2024-08-17T02:23:46.867 INFO:teuthology.orchestra.run.smithi150.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 9.9 MB/s | 3.4 MB 00:00 2024-08-17T02:23:46.902 INFO:teuthology.orchestra.run.smithi146.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 12 MB/s | 14 MB 00:01 2024-08-17T02:23:46.926 INFO:teuthology.orchestra.run.smithi150.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:23:46.984 INFO:teuthology.orchestra.run.smithi150.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 820 kB/s | 47 kB 00:00 2024-08-17T02:23:47.043 INFO:teuthology.orchestra.run.smithi150.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 251 kB/s | 15 kB 00:00 2024-08-17T02:23:47.070 INFO:teuthology.orchestra.run.smithi146.stdout:(9/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 9.5 MB/s | 15 MB 00:01 2024-08-17T02:23:47.095 INFO:teuthology.orchestra.run.smithi146.stdout:(10/133): ceph-selinux-17.2.7-1375.g2577e813.el 130 kB/s | 25 kB 00:00 2024-08-17T02:23:47.143 INFO:teuthology.orchestra.run.smithi150.stdout:(34/133): ceph-mgr-diskprediction-local-17.2.7- 13 MB/s | 7.4 MB 00:00 2024-08-17T02:23:47.145 INFO:teuthology.orchestra.run.smithi146.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.2 MB/s | 215 kB 00:00 2024-08-17T02:23:47.168 INFO:teuthology.orchestra.run.smithi150.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 2.1 MB/s | 269 kB 00:00 2024-08-17T02:23:47.194 INFO:teuthology.orchestra.run.smithi150.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:23:47.204 INFO:teuthology.orchestra.run.smithi146.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 429 kB/s | 25 kB 00:00 2024-08-17T02:23:47.227 INFO:teuthology.orchestra.run.smithi150.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 310 kB/s | 18 kB 00:00 2024-08-17T02:23:47.304 INFO:teuthology.orchestra.run.smithi146.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.2 MB/s | 636 kB 00:00 2024-08-17T02:23:47.371 INFO:teuthology.orchestra.run.smithi146.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:23:47.438 INFO:teuthology.orchestra.run.smithi146.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 1.9 MB/s | 126 kB 00:00 2024-08-17T02:23:47.497 INFO:teuthology.orchestra.run.smithi146.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 7.7 MB/s | 458 kB 00:00 2024-08-17T02:23:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:(17/133): librgw2-17.2.7-1375.g2577e813.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-17T02:23:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 909 kB/s | 45 kB 00:00 2024-08-17T02:23:47.911 INFO:teuthology.orchestra.run.smithi150.stdout:(38/133): ceph-test-17.2.7-1375.g2577e813.el9.x 17 MB/s | 48 MB 00:02 2024-08-17T02:23:47.945 INFO:teuthology.orchestra.run.smithi150.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-08-17T02:23:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:23:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 3.1 MB/s | 182 kB 00:00 2024-08-17T02:23:48.098 INFO:teuthology.orchestra.run.smithi146.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 4.3 MB/s | 369 kB 00:00 2024-08-17T02:23:48.165 INFO:teuthology.orchestra.run.smithi146.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.1 MB/s | 344 kB 00:00 2024-08-17T02:23:48.211 INFO:teuthology.orchestra.run.smithi150.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 950 kB/s | 253 kB 00:00 2024-08-17T02:23:48.232 INFO:teuthology.orchestra.run.smithi146.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.7 MB/s | 116 kB 00:00 2024-08-17T02:23:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 770 kB/s | 803 kB 00:01 2024-08-17T02:23:48.299 INFO:teuthology.orchestra.run.smithi146.stdout:(24/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.2 MB/s | 82 kB 00:00 2024-08-17T02:23:48.329 INFO:teuthology.orchestra.run.smithi150.stdout:(42/133): libquadmath-11.4.1-3.el9.x86_64.rpm 468 kB/s | 195 kB 00:00 2024-08-17T02:23:48.379 INFO:teuthology.orchestra.run.smithi150.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-08-17T02:23:48.438 INFO:teuthology.orchestra.run.smithi150.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-17T02:23:48.504 INFO:teuthology.orchestra.run.smithi150.stdout:(45/133): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-08-17T02:23:48.530 INFO:teuthology.orchestra.run.smithi150.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-08-17T02:23:48.555 INFO:teuthology.orchestra.run.smithi150.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-08-17T02:23:48.680 INFO:teuthology.orchestra.run.smithi150.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 174 kB/s | 22 kB 00:00 2024-08-17T02:23:48.758 INFO:teuthology.orchestra.run.smithi146.stdout:(25/133): ceph-test-17.2.7-1375.g2577e813.el9.x 28 MB/s | 48 MB 00:01 2024-08-17T02:23:48.772 INFO:teuthology.orchestra.run.smithi150.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-08-17T02:23:48.831 INFO:teuthology.orchestra.run.smithi146.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.2 MB/s | 165 kB 00:00 2024-08-17T02:23:48.831 INFO:teuthology.orchestra.run.smithi150.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-08-17T02:23:48.856 INFO:teuthology.orchestra.run.smithi150.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 391 kB/s | 33 kB 00:00 2024-08-17T02:23:48.882 INFO:teuthology.orchestra.run.smithi150.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-08-17T02:23:48.883 INFO:teuthology.orchestra.run.smithi146.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 5.0 MB/s | 2.9 MB 00:00 2024-08-17T02:23:48.910 INFO:teuthology.orchestra.run.smithi146.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 316 kB/s | 24 kB 00:00 2024-08-17T02:23:48.915 INFO:teuthology.orchestra.run.smithi150.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-08-17T02:23:48.934 INFO:teuthology.orchestra.run.smithi146.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:23:48.941 INFO:teuthology.orchestra.run.smithi150.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-08-17T02:23:48.974 INFO:teuthology.orchestra.run.smithi150.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:23:49.000 INFO:teuthology.orchestra.run.smithi150.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-08-17T02:23:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 24 MB/s | 3.4 MB 00:00 2024-08-17T02:23:49.083 INFO:teuthology.orchestra.run.smithi150.stdout:(57/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-08-17T02:23:49.109 INFO:teuthology.orchestra.run.smithi146.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:23:49.117 INFO:teuthology.orchestra.run.smithi150.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-08-17T02:23:49.134 INFO:teuthology.orchestra.run.smithi150.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-08-17T02:23:49.168 INFO:teuthology.orchestra.run.smithi150.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-08-17T02:23:49.168 INFO:teuthology.orchestra.run.smithi146.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 817 kB/s | 47 kB 00:00 2024-08-17T02:23:49.185 INFO:teuthology.orchestra.run.smithi150.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-08-17T02:23:49.210 INFO:teuthology.orchestra.run.smithi150.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-08-17T02:23:49.235 INFO:teuthology.orchestra.run.smithi150.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 526 kB/s | 35 kB 00:00 2024-08-17T02:23:49.243 INFO:teuthology.orchestra.run.smithi146.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 196 kB/s | 15 kB 00:00 2024-08-17T02:23:49.352 INFO:teuthology.orchestra.run.smithi146.stdout:(34/133): ceph-mgr-diskprediction-local-17.2.7- 18 MB/s | 7.4 MB 00:00 2024-08-17T02:23:49.377 INFO:teuthology.orchestra.run.smithi146.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 2.0 MB/s | 269 kB 00:00 2024-08-17T02:23:49.402 INFO:teuthology.orchestra.run.smithi146.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:23:49.428 INFO:teuthology.orchestra.run.smithi146.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 360 kB/s | 18 kB 00:00 2024-08-17T02:23:49.469 INFO:teuthology.orchestra.run.smithi150.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-08-17T02:23:49.528 INFO:teuthology.orchestra.run.smithi146.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 638 kB/s | 80 kB 00:00 2024-08-17T02:23:49.544 INFO:teuthology.orchestra.run.smithi150.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-08-17T02:23:49.569 INFO:teuthology.orchestra.run.smithi150.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-17T02:23:49.603 INFO:teuthology.orchestra.run.smithi150.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:23:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-08-17T02:23:49.628 INFO:teuthology.orchestra.run.smithi150.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-08-17T02:23:49.662 INFO:teuthology.orchestra.run.smithi146.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-08-17T02:23:49.687 INFO:teuthology.orchestra.run.smithi146.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-17T02:23:49.712 INFO:teuthology.orchestra.run.smithi150.stdout:(69/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:23:49.729 INFO:teuthology.orchestra.run.smithi146.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-17T02:23:49.737 INFO:teuthology.orchestra.run.smithi150.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-08-17T02:23:49.762 INFO:teuthology.orchestra.run.smithi150.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-17T02:23:49.763 INFO:teuthology.orchestra.run.smithi146.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-08-17T02:23:49.788 INFO:teuthology.orchestra.run.smithi150.stdout:(72/133): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-08-17T02:23:49.788 INFO:teuthology.orchestra.run.smithi146.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:23:49.813 INFO:teuthology.orchestra.run.smithi146.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:23:49.829 INFO:teuthology.orchestra.run.smithi150.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-17T02:23:49.839 INFO:teuthology.orchestra.run.smithi146.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-17T02:23:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-08-17T02:23:49.889 INFO:teuthology.orchestra.run.smithi150.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:23:49.905 INFO:teuthology.orchestra.run.smithi150.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-08-17T02:23:49.947 INFO:teuthology.orchestra.run.smithi150.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-17T02:23:49.972 INFO:teuthology.orchestra.run.smithi150.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-08-17T02:23:50.014 INFO:teuthology.orchestra.run.smithi146.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-08-17T02:23:50.048 INFO:teuthology.orchestra.run.smithi150.stdout:(79/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-08-17T02:23:50.056 INFO:teuthology.orchestra.run.smithi146.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 525 kB/s | 22 kB 00:00 2024-08-17T02:23:50.073 INFO:teuthology.orchestra.run.smithi150.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 405 kB/s | 51 kB 00:00 2024-08-17T02:23:50.098 INFO:teuthology.orchestra.run.smithi146.stdout:(49/133): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-08-17T02:23:50.099 INFO:teuthology.orchestra.run.smithi150.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-08-17T02:23:50.123 INFO:teuthology.orchestra.run.smithi146.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-08-17T02:23:50.123 INFO:teuthology.orchestra.run.smithi150.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-08-17T02:23:50.148 INFO:teuthology.orchestra.run.smithi146.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-08-17T02:23:50.174 INFO:teuthology.orchestra.run.smithi150.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-08-17T02:23:50.191 INFO:teuthology.orchestra.run.smithi146.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-08-17T02:23:50.199 INFO:teuthology.orchestra.run.smithi150.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-08-17T02:23:50.233 INFO:teuthology.orchestra.run.smithi146.stdout:(53/133): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-08-17T02:23:50.233 INFO:teuthology.orchestra.run.smithi150.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:23:50.258 INFO:teuthology.orchestra.run.smithi150.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-08-17T02:23:50.291 INFO:teuthology.orchestra.run.smithi146.stdout:(54/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-08-17T02:23:50.317 INFO:teuthology.orchestra.run.smithi146.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-08-17T02:23:50.351 INFO:teuthology.orchestra.run.smithi150.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-08-17T02:23:50.376 INFO:teuthology.orchestra.run.smithi150.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.1 MB/s | 309 kB 00:00 2024-08-17T02:23:50.392 INFO:teuthology.orchestra.run.smithi146.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-08-17T02:23:50.401 INFO:teuthology.orchestra.run.smithi150.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:23:50.426 INFO:teuthology.orchestra.run.smithi150.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:23:50.433 INFO:teuthology.orchestra.run.smithi146.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-08-17T02:23:50.452 INFO:teuthology.orchestra.run.smithi150.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:23:50.477 INFO:teuthology.orchestra.run.smithi150.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 564 kB/s | 14 kB 00:00 2024-08-17T02:23:50.503 INFO:teuthology.orchestra.run.smithi150.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.7 MB/s | 172 kB 00:00 2024-08-17T02:23:50.528 INFO:teuthology.orchestra.run.smithi150.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.5 MB/s | 548 kB 00:00 2024-08-17T02:23:50.570 INFO:teuthology.orchestra.run.smithi150.stdout:(95/133): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-08-17T02:23:50.595 INFO:teuthology.orchestra.run.smithi150.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-08-17T02:23:50.620 INFO:teuthology.orchestra.run.smithi150.stdout:(97/133): python3-google-auth-2.33.0-1.el9.noar 2.3 MB/s | 220 kB 00:00 2024-08-17T02:23:50.637 INFO:teuthology.orchestra.run.smithi150.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 423 kB/s | 18 kB 00:00 2024-08-17T02:23:50.654 INFO:teuthology.orchestra.run.smithi150.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 693 kB/s | 23 kB 00:00 2024-08-17T02:23:50.659 INFO:teuthology.orchestra.run.smithi146.stdout:(58/133): ceph-common-17.2.7-1375.g2577e813.el9 3.3 MB/s | 22 MB 00:06 2024-08-17T02:23:50.671 INFO:teuthology.orchestra.run.smithi150.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 578 kB/s | 19 kB 00:00 2024-08-17T02:23:50.684 INFO:teuthology.orchestra.run.smithi146.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 102 kB/s | 25 kB 00:00 2024-08-17T02:23:50.688 INFO:teuthology.orchestra.run.smithi150.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-08-17T02:23:50.713 INFO:teuthology.orchestra.run.smithi150.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 217 kB/s | 9.0 kB 00:00 2024-08-17T02:23:50.718 INFO:teuthology.orchestra.run.smithi146.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2024-08-17T02:23:50.739 INFO:teuthology.orchestra.run.smithi150.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2024-08-17T02:23:50.764 INFO:teuthology.orchestra.run.smithi150.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:23:50.769 INFO:teuthology.orchestra.run.smithi146.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-17T02:23:50.789 INFO:teuthology.orchestra.run.smithi150.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:23:50.802 INFO:teuthology.orchestra.run.smithi146.stdout:(62/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-08-17T02:23:50.815 INFO:teuthology.orchestra.run.smithi150.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:23:50.827 INFO:teuthology.orchestra.run.smithi146.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 35 kB 00:00 2024-08-17T02:23:50.848 INFO:teuthology.orchestra.run.smithi150.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-08-17T02:23:50.874 INFO:teuthology.orchestra.run.smithi150.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-08-17T02:23:50.899 INFO:teuthology.orchestra.run.smithi150.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:23:50.941 INFO:teuthology.orchestra.run.smithi150.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-08-17T02:23:50.952 INFO:teuthology.orchestra.run.smithi146.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-08-17T02:23:50.966 INFO:teuthology.orchestra.run.smithi150.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-08-17T02:23:50.992 INFO:teuthology.orchestra.run.smithi150.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:23:51.017 INFO:teuthology.orchestra.run.smithi150.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:23:51.019 INFO:teuthology.orchestra.run.smithi146.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-08-17T02:23:51.042 INFO:teuthology.orchestra.run.smithi150.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-17T02:23:51.044 INFO:teuthology.orchestra.run.smithi146.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-08-17T02:23:51.068 INFO:teuthology.orchestra.run.smithi150.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:23:51.078 INFO:teuthology.orchestra.run.smithi146.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-17T02:23:51.093 INFO:teuthology.orchestra.run.smithi150.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:23:51.103 INFO:teuthology.orchestra.run.smithi146.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-08-17T02:23:51.118 INFO:teuthology.orchestra.run.smithi150.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:23:51.129 INFO:teuthology.orchestra.run.smithi146.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-08-17T02:23:51.135 INFO:teuthology.orchestra.run.smithi150.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-17T02:23:51.169 INFO:teuthology.orchestra.run.smithi150.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-17T02:23:51.170 INFO:teuthology.orchestra.run.smithi146.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-08-17T02:23:51.196 INFO:teuthology.orchestra.run.smithi146.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-08-17T02:23:51.236 INFO:teuthology.orchestra.run.smithi150.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-17T02:23:51.246 INFO:teuthology.orchestra.run.smithi146.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-17T02:23:51.338 INFO:teuthology.orchestra.run.smithi146.stdout:(73/133): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-08-17T02:23:51.363 INFO:teuthology.orchestra.run.smithi146.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-08-17T02:23:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-08-17T02:23:51.447 INFO:teuthology.orchestra.run.smithi146.stdout:(76/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-08-17T02:23:51.461 INFO:teuthology.orchestra.run.smithi150.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-08-17T02:23:51.464 INFO:teuthology.orchestra.run.smithi146.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-08-17T02:23:51.489 INFO:teuthology.orchestra.run.smithi146.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-08-17T02:23:51.514 INFO:teuthology.orchestra.run.smithi146.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:23:51.545 INFO:teuthology.orchestra.run.smithi150.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 8.2 MB/s | 3.1 MB 00:00 2024-08-17T02:23:51.565 INFO:teuthology.orchestra.run.smithi146.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 715 kB/s | 54 kB 00:00 2024-08-17T02:23:51.590 INFO:teuthology.orchestra.run.smithi146.stdout:(81/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-08-17T02:23:51.615 INFO:teuthology.orchestra.run.smithi146.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-08-17T02:23:51.620 INFO:teuthology.orchestra.run.smithi150.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 7.7 MB/s | 2.9 MB 00:00 2024-08-17T02:23:51.641 INFO:teuthology.orchestra.run.smithi146.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-17T02:23:51.666 INFO:teuthology.orchestra.run.smithi146.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:23:51.691 INFO:teuthology.orchestra.run.smithi146.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:23:51.716 INFO:teuthology.orchestra.run.smithi146.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-08-17T02:23:51.795 INFO:teuthology.orchestra.run.smithi150.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 233 kB/s | 41 kB 00:00 2024-08-17T02:23:51.808 INFO:teuthology.orchestra.run.smithi146.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2024-08-17T02:23:51.834 INFO:teuthology.orchestra.run.smithi146.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-17T02:23:51.867 INFO:teuthology.orchestra.run.smithi146.stdout:(89/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.7 MB/s | 309 kB 00:00 2024-08-17T02:23:51.901 INFO:teuthology.orchestra.run.smithi146.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-08-17T02:23:51.943 INFO:teuthology.orchestra.run.smithi146.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 777 kB/s | 32 kB 00:00 2024-08-17T02:23:51.968 INFO:teuthology.orchestra.run.smithi146.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 559 kB/s | 14 kB 00:00 2024-08-17T02:23:52.002 INFO:teuthology.orchestra.run.smithi146.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-17T02:23:52.035 INFO:teuthology.orchestra.run.smithi146.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 2.7 MB/s | 548 kB 00:00 2024-08-17T02:23:52.062 INFO:teuthology.orchestra.run.smithi150.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 927 kB/s | 247 kB 00:00 2024-08-17T02:23:52.069 INFO:teuthology.orchestra.run.smithi146.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:23:52.086 INFO:teuthology.orchestra.run.smithi146.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 632 kB/s | 11 kB 00:00 2024-08-17T02:23:52.111 INFO:teuthology.orchestra.run.smithi146.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:23:52.137 INFO:teuthology.orchestra.run.smithi146.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 353 kB/s | 18 kB 00:00 2024-08-17T02:23:52.146 INFO:teuthology.orchestra.run.smithi150.stdout:(126/133): NetworkManager-1.48.2-2.el9.x86_64.r 3.4 MB/s | 2.3 MB 00:00 2024-08-17T02:23:52.162 INFO:teuthology.orchestra.run.smithi146.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:23:52.163 INFO:teuthology.orchestra.run.smithi150.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 366 kB/s | 37 kB 00:00 2024-08-17T02:23:52.188 INFO:teuthology.orchestra.run.smithi146.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-17T02:23:52.213 INFO:teuthology.orchestra.run.smithi146.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-08-17T02:23:52.238 INFO:teuthology.orchestra.run.smithi146.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 181 kB/s | 9.0 kB 00:00 2024-08-17T02:23:52.263 INFO:teuthology.orchestra.run.smithi150.stdout:(128/133): NetworkManager-libnm-1.48.2-2.el9.x8 2.5 MB/s | 1.8 MB 00:00 2024-08-17T02:23:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 812 kB/s | 41 kB 00:00 2024-08-17T02:23:52.289 INFO:teuthology.orchestra.run.smithi150.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.4 MB/s | 207 kB 00:00 2024-08-17T02:23:52.289 INFO:teuthology.orchestra.run.smithi146.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:23:52.314 INFO:teuthology.orchestra.run.smithi150.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 1.7 MB/s | 260 kB 00:00 2024-08-17T02:23:52.331 INFO:teuthology.orchestra.run.smithi146.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-08-17T02:23:52.356 INFO:teuthology.orchestra.run.smithi146.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:23:52.389 INFO:teuthology.orchestra.run.smithi150.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-08-17T02:23:52.389 INFO:teuthology.orchestra.run.smithi146.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:23:52.415 INFO:teuthology.orchestra.run.smithi146.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-17T02:23:52.440 INFO:teuthology.orchestra.run.smithi146.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-08-17T02:23:52.466 INFO:teuthology.orchestra.run.smithi146.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:23:52.499 INFO:teuthology.orchestra.run.smithi146.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-08-17T02:23:52.514 INFO:teuthology.orchestra.run.smithi150.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-17T02:23:52.524 INFO:teuthology.orchestra.run.smithi146.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-08-17T02:23:52.548 INFO:teuthology.orchestra.run.smithi150.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2024-08-17T02:23:52.550 INFO:teuthology.orchestra.run.smithi146.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-17T02:23:52.552 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:23:52.552 INFO:teuthology.orchestra.run.smithi150.stdout:Total 22 MB/s | 206 MB 00:09 2024-08-17T02:23:52.575 INFO:teuthology.orchestra.run.smithi146.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:23:52.600 INFO:teuthology.orchestra.run.smithi146.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-17T02:23:52.626 INFO:teuthology.orchestra.run.smithi146.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:23:52.651 INFO:teuthology.orchestra.run.smithi146.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:23:52.676 INFO:teuthology.orchestra.run.smithi146.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-08-17T02:23:52.726 INFO:teuthology.orchestra.run.smithi146.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-08-17T02:23:52.785 INFO:teuthology.orchestra.run.smithi146.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-17T02:23:52.960 INFO:teuthology.orchestra.run.smithi146.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 13 MB/s | 3.1 MB 00:00 2024-08-17T02:23:53.169 INFO:teuthology.orchestra.run.smithi146.stdout:(122/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.8 MB/s | 16 MB 00:01 2024-08-17T02:23:53.228 INFO:teuthology.orchestra.run.smithi146.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 6.6 MB/s | 2.9 MB 00:00 2024-08-17T02:23:53.286 INFO:teuthology.orchestra.run.smithi146.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 7.1 MB/s | 2.3 MB 00:00 2024-08-17T02:23:53.345 INFO:teuthology.orchestra.run.smithi146.stdout:(125/133): NetworkManager-libnm-1.48.2-2.el9.x8 10 MB/s | 1.8 MB 00:00 2024-08-17T02:23:53.370 INFO:teuthology.orchestra.run.smithi146.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.9 MB/s | 247 kB 00:00 2024-08-17T02:23:53.396 INFO:teuthology.orchestra.run.smithi146.stdout:(127/133): NetworkManager-team-1.48.2-2.el9.x86 243 kB/s | 41 kB 00:00 2024-08-17T02:23:53.421 INFO:teuthology.orchestra.run.smithi146.stdout:(128/133): elfutils-debuginfod-client-0.191-4.e 487 kB/s | 37 kB 00:00 2024-08-17T02:23:53.447 INFO:teuthology.orchestra.run.smithi146.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-08-17T02:23:53.496 INFO:teuthology.orchestra.run.smithi146.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-08-17T02:23:53.547 INFO:teuthology.orchestra.run.smithi146.stdout:(131/133): elfutils-libs-0.191-4.el9.x86_64.rpm 1.7 MB/s | 260 kB 00:00 2024-08-17T02:23:53.589 INFO:teuthology.orchestra.run.smithi146.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-08-17T02:23:53.639 INFO:teuthology.orchestra.run.smithi146.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-08-17T02:23:53.643 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:23:53.644 INFO:teuthology.orchestra.run.smithi146.stdout:Total 20 MB/s | 206 MB 00:10 2024-08-17T02:23:54.254 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-08-17T02:23:54.465 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-08-17T02:23:54.465 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-08-17T02:23:55.375 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-08-17T02:23:55.584 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-08-17T02:23:55.584 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-08-17T02:23:56.585 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-08-17T02:23:56.586 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-08-17T02:23:57.691 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-08-17T02:23:57.691 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-08-17T02:24:02.339 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-08-17T02:24:02.429 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:24:02.479 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:24:02.553 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:24:02.597 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:24:02.630 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:24:02.686 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:24:03.020 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:24:03.121 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:03.257 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:03.289 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:03.414 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:03.562 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-08-17T02:24:03.660 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:24:03.716 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:24:03.785 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:24:03.829 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:24:03.861 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:24:03.888 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:03.916 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:03.921 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:24:04.049 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:04.141 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:24:04.176 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:04.282 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:24:04.297 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:04.327 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:04.412 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:04.481 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:04.556 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:04.596 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:04.713 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:04.792 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:24:05.187 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:05.222 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:05.267 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:05.323 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:05.345 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:05.390 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:24:05.416 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:05.461 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:05.521 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:05.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:05.569 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:05.688 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:24:05.916 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:05.956 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:24:05.967 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:24:06.012 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:24:06.096 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:24:06.147 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:24:06.179 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:24:06.181 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:06.259 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:24:06.269 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:24:06.348 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:24:06.382 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:24:06.386 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:06.455 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:24:06.492 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:06.543 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:24:06.578 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:24:06.624 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:24:06.716 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:24:06.857 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:24:06.878 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:24:06.901 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:24:06.936 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:24:06.945 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:24:07.028 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:24:07.069 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:24:07.129 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:24:07.218 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:24:07.279 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:24:07.315 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:24:07.362 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:24:07.449 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:24:07.485 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:24:07.547 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:24:07.586 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:24:07.641 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:24:07.689 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:24:07.738 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:24:07.792 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:24:07.800 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:24:07.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:24:07.983 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:24:08.117 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:24:08.174 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:24:08.217 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:24:08.360 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:24:08.442 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:24:08.478 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:24:08.532 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:24:08.546 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:24:08.598 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:24:08.636 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:24:08.656 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:24:08.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:24:08.740 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:24:08.783 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:24:08.821 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:24:08.826 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:24:08.874 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:24:08.881 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:24:08.913 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:24:08.941 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:24:08.974 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:24:09.057 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:24:09.058 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:24:09.098 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:24:09.106 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:24:09.143 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:24:09.155 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:24:09.189 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:24:09.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:24:09.225 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:24:09.253 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:24:09.263 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:24:09.301 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:24:09.303 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:24:09.336 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:24:09.369 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:24:09.412 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:24:09.445 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:24:09.475 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:24:09.480 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:24:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:24:09.654 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:24:09.718 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:24:09.736 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:24:09.780 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:24:09.907 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:24:09.962 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:24:10.015 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:24:10.052 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:24:10.088 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:24:10.127 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:24:10.164 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:24:10.199 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:24:10.235 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:24:10.275 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:24:10.324 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:24:10.360 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:24:10.410 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:24:10.532 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:24:10.600 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:24:10.606 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:24:10.654 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:24:10.688 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:24:10.803 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:10.851 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:24:11.076 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:24:11.111 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:24:11.210 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:24:11.489 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:24:11.551 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:24:11.583 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:24:11.700 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:11.750 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:24:11.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:24:12.006 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:24:12.013 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:24:12.101 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:24:12.156 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:24:12.912 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:24:13.077 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:24:13.765 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:24:13.866 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:24:13.902 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:24:13.935 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:24:14.255 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:24:14.297 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:14.396 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:14.423 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:24:14.650 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:24:14.744 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:24:14.780 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:24:14.813 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:24:15.131 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:24:15.174 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:15.273 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:24:15.332 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:24:17.095 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:17.129 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:17.756 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:17.807 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:17.951 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:17.951 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:24:17.951 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:17.951 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:17.983 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:24:17.998 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:18.089 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:18.699 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:24:18.742 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:18.891 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:24:18.891 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:24:18.891 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:24:18.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:18.935 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-08-17T02:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-08-17T02:24:29.724 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-08-17T02:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-08-17T02:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-08-17T02:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /root 2024-08-17T02:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-08-17T02:24:29.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:29.931 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:24:29.966 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:24:29.967 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-08-17T02:24:30.916 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:31.135 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:24:31.171 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:24:31.171 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:31.172 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:24:31.172 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:31.477 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:24:31.535 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:24:31.535 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:31.536 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:24:31.536 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:31.536 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:31.536 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:31.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:31.811 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:32.211 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:24:32.262 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:24:32.262 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:32.263 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:24:32.263 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:32.263 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:32.263 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:32.387 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:24:32.447 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:24:32.520 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:24:32.706 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:24:32.746 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:24:32.764 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:24:32.765 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:32.765 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:24:32.765 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:32.765 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:24:32.765 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:32.799 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:24:32.885 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:24:32.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:24:32.989 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:24:33.042 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:24:33.042 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:33.042 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:24:33.042 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:33.042 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:24:33.043 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:33.156 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:24:33.212 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:24:33.266 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:24:33.306 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:24:33.347 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:24:33.373 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:24:33.448 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:24:33.500 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:33.623 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:24:33.684 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:24:33.757 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:24:33.845 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:24:33.880 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:24:33.901 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:24:33.955 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:24:33.986 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:24:34.007 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:24:34.069 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:24:34.154 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:24:34.288 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:24:34.462 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:24:34.515 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:24:34.541 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:24:34.594 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:24:34.642 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:24:34.667 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:24:35.133 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:24:35.171 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:24:35.230 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:24:35.259 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:24:35.296 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:24:35.358 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:24:35.389 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:24:36.260 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:24:36.288 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:24:36.425 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:24:36.547 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:24:36.585 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:24:36.591 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:24:36.624 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:24:36.675 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:24:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:24:36.675 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:36.676 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:36.676 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:36.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:24:36.758 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:24:36.859 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:24:36.920 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:24:37.688 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:24:37.716 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:24:37.855 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:24:38.020 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:24:38.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:24:38.126 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:24:38.126 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:38.126 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:24:38.127 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:38.127 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:24:38.127 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:38.186 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:24:38.212 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:24:38.230 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:24:38.269 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:24:38.312 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:24:38.365 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:24:38.365 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:38.365 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:24:38.366 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:38.366 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:38.366 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:38.368 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:24:38.420 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:24:38.469 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:24:38.469 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:38.469 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:24:38.469 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:38.537 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:24:38.588 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:24:38.588 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:38.588 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:24:38.588 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:38.588 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:38.589 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:38.913 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:24:38.964 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:24:38.964 INFO:teuthology.orchestra.run.smithi150.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:38.964 INFO:teuthology.orchestra.run.smithi150.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:24:38.964 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:24:38.964 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:24:38.965 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:39.710 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:24:39.755 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:24:39.868 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:24:39.869 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:39.948 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:24:39.998 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:24:39.998 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:39.999 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:24:39.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:40.065 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:24:40.117 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.118 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:24:40.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:24:40.493 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:24:40.493 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:24:40.493 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:24:40.494 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:24:40.494 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:24:40.494 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:43.951 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:24:43.992 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:24:44.036 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:24:44.065 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:24:44.098 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:24:44.133 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:24:44.173 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:24:44.204 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:44.260 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:24:45.244 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:24:45.286 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:24:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:24:45.392 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:24:45.426 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:24:45.461 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:24:45.500 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:24:45.532 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:45.579 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:24:45.588 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:24:45.836 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:24:45.928 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:24:45.978 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:24:46.079 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:24:46.117 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:24:46.142 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:24:46.168 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:46.196 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:24:46.196 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:46.296 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:24:46.328 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:46.438 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:46.463 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:24:46.479 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:46.479 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:46.724 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:46.724 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:46.857 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:46.882 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:24:46.885 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:24:46.965 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:47.131 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:24:47.179 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:47.179 INFO:teuthology.orchestra.run.smithi150.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:24:47.180 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:47.191 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:24:47.294 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:24:47.748 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:24:47.786 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:24:47.811 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:24:47.868 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:24:47.907 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:48.006 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:48.047 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:24:48.047 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:48.157 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:48.181 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:48.442 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:48.442 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:48.552 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:48.584 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:48.653 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:24:48.733 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:48.945 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:48.946 INFO:teuthology.orchestra.run.smithi146.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:24:48.946 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:52.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:24:52.498 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:52.499 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:24:52.500 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:24:52.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:24:52.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:24:52.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:24:52.501 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:24:52.511 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:24:52.512 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:24:52.513 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:24:52.514 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:24:52.515 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:24:52.516 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:24:52.517 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:24:52.518 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:52.519 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:52.520 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:24:54.042 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:24:54.043 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:24:54.044 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:24:54.062 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:54.063 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:54.436 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-08-17T02:24:54.437 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.439 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:24:54.440 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.441 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:24:54.443 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:24:54.447 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:24:54.448 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:24:54.449 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:24:54.449 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:24:54.449 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-08-17T02:24:55.075 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:56.034 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:56.034 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:24:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:24:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:24:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:24:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:24:56.044 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:24:56.045 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:24:56.046 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-08-17T02:24:56.670 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:56.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:56.813 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:24:56.861 INFO:teuthology.orchestra.run.smithi146.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:24:56.861 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:24:56.862 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:24:56.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:57.004 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:24:57.050 INFO:teuthology.orchestra.run.smithi150.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:24:57.050 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:24:57.050 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:24:57.052 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:24:57.052 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:57.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:57.118 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:57.118 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:57.177 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:24:57.177 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:57.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:57.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:57.333 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:57.333 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:57.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:57.484 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:24:57.484 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:57.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:57.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:57.640 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:57.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:57.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:57.792 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:24:57.792 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:57.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:57.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:57.946 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:57.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:58.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:58.099 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:24:58.172 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:24:58.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:58.176 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:58.232 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:24:58.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:58.236 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:58.291 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:24:58.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:58.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:58.356 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:24:58.356 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:24:58.356 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:24:58.356 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:58.356 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:58.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:58.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:58.630 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:58.630 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:58.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:58.832 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:58.895 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:24:58.895 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:24:58.896 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858276', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDsanbEflKTSakTQ5yzpdS4ecksFFukDLyKEi18v2LKtsSna9ogWI9vK5NOR70+b6jeaxNz4uPs1KSzRE0LuXTg=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8Lo80LPJRKNuvei7/EzJGaBsRqOejqvFQ86LIzcmH83UBKhvN1IicAOFmJxARF1p7PIWW3IMT3zJN6mmQ+KBc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:24:58.896 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:58.900 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:58.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:58.977 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:59.032 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:24:59.032 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:59.067 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:59.067 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-08-17 02:24:49.277214095 +0000 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-08-17 02:22:30.886266543 +0000 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-08-17 02:22:30.886266543 +0000 2024-08-17T02:24:59.143 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-08-17 02:22:30.886266543 +0000 2024-08-17T02:24:59.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:24:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-08-17T02:24:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-08-17T02:24:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000320113 s, 1.6 MB/s 2024-08-17T02:24:59.238 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:24:59.275 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-08-17T02:24:59.350 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:24:59.350 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.350 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:24:59.350 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.350 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:59.351 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-08-17 02:24:49.278214079 +0000 2024-08-17T02:24:59.351 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-08-17 02:22:31.358259582 +0000 2024-08-17T02:24:59.351 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-08-17 02:22:31.358259582 +0000 2024-08-17T02:24:59.351 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-08-17 02:22:31.358259582 +0000 2024-08-17T02:24:59.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:24:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-08-17T02:24:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-08-17T02:24:59.444 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00024633 s, 2.1 MB/s 2024-08-17T02:24:59.446 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:24:59.483 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:59.559 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-08-17 02:24:49.279214064 +0000 2024-08-17T02:24:59.560 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-08-17 02:22:31.858252207 +0000 2024-08-17T02:24:59.560 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-08-17 02:22:31.858252207 +0000 2024-08-17T02:24:59.560 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-08-17 02:22:31.858252207 +0000 2024-08-17T02:24:59.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:24:59.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-08-17T02:24:59.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-08-17T02:24:59.652 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000323262 s, 1.6 MB/s 2024-08-17T02:24:59.655 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:24:59.691 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-08-17 02:24:49.279214064 +0000 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-08-17 02:22:32.355244877 +0000 2024-08-17T02:24:59.767 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-08-17 02:22:32.355244877 +0000 2024-08-17T02:24:59.768 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-08-17 02:22:32.355244877 +0000 2024-08-17T02:24:59.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:24:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-08-17T02:24:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-08-17T02:24:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000247679 s, 2.1 MB/s 2024-08-17T02:24:59.862 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:24:59.899 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:59.899 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:24:59.899 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:59.937 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:59.938 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-08-17T02:25:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:25:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.015 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 635 Links: 1 2024-08-17T02:25:00.016 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.016 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:00.016 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-08-17 02:24:47.531544331 +0000 2024-08-17T02:25:00.016 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-08-17 02:22:30.103419514 +0000 2024-08-17T02:25:00.016 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-08-17 02:22:30.103419514 +0000 2024-08-17T02:25:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-08-17 02:22:30.103419514 +0000 2024-08-17T02:25:00.017 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:25:00.109 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-08-17T02:25:00.109 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-08-17T02:25:00.109 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000263914 s, 1.9 MB/s 2024-08-17T02:25:00.112 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:25:00.149 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-08-17T02:25:00.224 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-08-17 02:24:47.532544312 +0000 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-08-17 02:22:30.573410595 +0000 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-08-17 02:22:30.573410595 +0000 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-08-17 02:22:30.573410595 +0000 2024-08-17T02:25:00.225 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:25:00.318 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-08-17T02:25:00.318 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-08-17T02:25:00.318 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000465521 s, 1.1 MB/s 2024-08-17T02:25:00.321 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:25:00.357 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-08-17 02:24:47.532544312 +0000 2024-08-17T02:25:00.432 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-08-17 02:22:31.056401429 +0000 2024-08-17T02:25:00.433 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-08-17 02:22:31.056401429 +0000 2024-08-17T02:25:00.433 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-08-17 02:22:31.056401429 +0000 2024-08-17T02:25:00.433 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000303928 s, 1.7 MB/s 2024-08-17T02:25:00.527 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:25:00.563 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-08-17T02:25:00.639 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:25:00.639 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:25:00.639 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 692 Links: 1 2024-08-17T02:25:00.639 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:25:00.640 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:25:00.640 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-08-17 02:24:47.533544293 +0000 2024-08-17T02:25:00.640 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-08-17 02:22:31.513392756 +0000 2024-08-17T02:25:00.640 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-08-17 02:22:31.513392756 +0000 2024-08-17T02:25:00.640 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: 2024-08-17 02:22:31.513392756 +0000 2024-08-17T02:25:00.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:25:00.732 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-08-17T02:25:00.732 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-08-17T02:25:00.732 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000433954 s, 1.2 MB/s 2024-08-17T02:25:00.735 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:25:00.771 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:00.771 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:00.771 INFO:tasks.ceph:Generating config... 2024-08-17T02:25:00.773 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:25:00.773 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:25:00.773 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:25:00.773 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:25:00.774 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:25:00.774 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:25:00.774 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:25:00.774 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:25:00.775 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:25:00.775 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:25:00.775 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:25:00.775 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:25:00.776 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:25:00.777 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:25:00.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:00.873 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:25:00.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:25:00.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.014 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2024-08-17T02:25:01.015 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:25:01.016 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:01.016 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:01.051 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.161 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 955175c7-decf-4b1d-aa3f-b20724739e7d 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:setting min_mon_release = octopus 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 955175c7-decf-4b1d-aa3f-b20724739e7d 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2024-08-17T02:25:01.162022+0000 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:created 2024-08-17T02:25:01.162022+0000 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 15 (octopus) 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:25:01.164 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:25:01.199 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 955175c7-decf-4b1d-aa3f-b20724739e7d... 2024-08-17T02:25:01.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:01.243 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:25:01.336 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-08-17T02:25:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-08-17T02:25:01.336 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-08-17T02:25:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:01.338 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.339 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 955175c7-decf-4b1d-aa3f-b20724739e7d 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:01.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-08-17T02:25:01.342 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-08-17T02:25:01.343 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: debug finisher = 20 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.344 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:01.345 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2024-08-17T02:25:01.348 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:25:01.351 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.146,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-08-17T02:25:01.352 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 955175c7-decf-4b1d-aa3f-b20724739e7d 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-08-17T02:25:01.353 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.354 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-08-17T02:25:01.355 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-08-17T02:25:01.356 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug finisher = 20 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:25:01.357 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-08-17T02:25:01.358 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-08-17T02:25:01.359 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2024-08-17T02:25:01.360 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-08-17T02:25:01.361 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-08-17T02:25:01.367 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:25:01.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:25:01.458 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:25:01.458 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:01.458 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:25:01.494 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:01.494 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:25:01.569 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:25:01.570 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:01.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:01.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.688 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:01.688 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.764 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:25:01.764 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:01.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:25:01.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:25:01.844 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:01.844 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:01.919 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:25:01.919 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:25:01.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:02.019 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:25:02.024 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:02.131 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:25:02.137 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:25:02.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:02.236 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:25:02.241 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:25:02.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:02.393 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:25:02.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:25:02.453 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:02.552 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:25:02.557 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:25:02.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:02.711 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:25:02.715 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:25:02.771 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:25:02.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:02.848 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:25:02.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:02.949 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:25:02.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:03.052 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:25:03.079 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:03.155 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:25:03.182 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:25:03.182 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:25:03.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:03.240 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:03.240 INFO:tasks.ceph:role: osd.0 2024-08-17T02:25:03.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:25:03.241 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:03.302 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:03.303 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:03.707 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-08-17T02:25:03.711 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-08-17T02:25:03.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:03.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:03.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:03.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:03.959 INFO:tasks.ceph:role: osd.1 2024-08-17T02:25:03.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:25:03.959 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:04.025 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:04.026 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:04.026 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:04.382 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-08-17T02:25:04.386 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-08-17T02:25:04.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:04.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:04.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:04.609 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:04.609 INFO:tasks.ceph:role: osd.2 2024-08-17T02:25:04.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:25:04.609 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:04.672 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:04.673 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:04.673 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:05.054 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-08-17T02:25:05.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-08-17T02:25:05.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:05.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:05.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:05.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:05.273 INFO:tasks.ceph:role: osd.3 2024-08-17T02:25:05.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:25:05.273 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:05.336 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:05.336 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:05.336 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:05.336 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:05.337 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:05.757 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-08-17T02:25:05.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-08-17T02:25:05.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:05.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:05.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:06.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.067+0000 7fca18f1f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.073+0000 7fca18f1f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.073+0000 7fca18f1f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.073+0000 7fca18f1f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.073+0000 7fca18f1f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.081+0000 7fca18f1f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:25:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:06.634+0000 7fca18f1f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:07.405+0000 7fca18f1f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:08.180+0000 7fca18f1f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:09.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:25:09.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:09.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.178+0000 7fb9b19882c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:25:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.178+0000 7fb9b19882c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:25:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.178+0000 7fb9b19882c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.178+0000 7fb9b19882c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.178+0000 7fb9b19882c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:25:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.180+0000 7fb9b19882c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:25:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:09.724+0000 7fb9b19882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:10.510+0000 7fb9b19882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:11.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:11.281+0000 7fb9b19882c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:12.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:25:12.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:12.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.267+0000 7fb4dc91c2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:25:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.268+0000 7fb4dc91c2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:25:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.268+0000 7fb4dc91c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.268+0000 7fb4dc91c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.268+0000 7fb4dc91c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:25:12.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.270+0000 7fb4dc91c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:25:12.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:12.812+0000 7fb4dc91c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:13.584+0000 7fb4dc91c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:14.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:14.368+0000 7fb4dc91c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:15.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:25:15.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.432+0000 7fd6483232c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:25:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.433+0000 7fd6483232c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:25:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.433+0000 7fd6483232c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:15.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.433+0000 7fd6483232c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:15.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.433+0000 7fd6483232c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:25:15.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.435+0000 7fd6483232c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:25:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:15.988+0000 7fd6483232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:16.768+0000 7fd6483232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:17.537+0000 7fd6483232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:18.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:25:18.428 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:18.490 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:18.491 INFO:tasks.ceph:role: osd.4 2024-08-17T02:25:18.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:25:18.491 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:18.556 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:18.557 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:18.955 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-08-17T02:25:18.959 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-08-17T02:25:18.959 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:19.099 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:19.167 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:19.224 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:19.224 INFO:tasks.ceph:role: osd.5 2024-08-17T02:25:19.224 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:25:19.224 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:19.288 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:19.289 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:19.289 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:19.289 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:19.644 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-08-17T02:25:19.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-08-17T02:25:19.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:19.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:19.798 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:19.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:19.854 INFO:tasks.ceph:role: osd.6 2024-08-17T02:25:19.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:25:19.854 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:19.916 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:19.917 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:19.917 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:19.917 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:19.917 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:20.303 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-08-17T02:25:20.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-08-17T02:25:20.307 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:20.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:20.462 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:20.518 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:25:20.518 INFO:tasks.ceph:role: osd.7 2024-08-17T02:25:20.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:25:20.519 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:25:20.582 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-08-17T02:25:21.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-08-17T02:25:21.003 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:21.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:21.199 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:21.301 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.300+0000 7f4b368092c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:25:21.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.304+0000 7f4b368092c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:25:21.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.304+0000 7f4b368092c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:21.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.304+0000 7f4b368092c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:21.305 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.304+0000 7f4b368092c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:25:21.313 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.311+0000 7f4b368092c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:25:21.851 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:21.850+0000 7f4b368092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:22.624 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:22.623+0000 7f4b368092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:23.396 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:23.394+0000 7f4b368092c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:24.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:25:24.290 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:24.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.373+0000 7f1c144332c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:25:24.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.374+0000 7f1c144332c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:25:24.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.374+0000 7f1c144332c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:24.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.374+0000 7f1c144332c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:24.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.374+0000 7f1c144332c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:25:24.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.376+0000 7f1c144332c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:25:24.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:24.919+0000 7f1c144332c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:25.693 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:25.693+0000 7f1c144332c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:26.464 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:26.463+0000 7f1c144332c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:27.298 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:25:27.355 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:27.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.438+0000 7fceccf862c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:25:27.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.439+0000 7fceccf862c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:25:27.439 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.439+0000 7fceccf862c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:27.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.439+0000 7fceccf862c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:27.440 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.439+0000 7fceccf862c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:25:27.441 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.441+0000 7fceccf862c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:25:27.981 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:27.981+0000 7fceccf862c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:28.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:28.753+0000 7fceccf862c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:28.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:28.902 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:29.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:29.525+0000 7fceccf862c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:30.377 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:25:30.432 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.516+0000 7f7cb363d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:25:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.517+0000 7f7cb363d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:25:30.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.517+0000 7f7cb363d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.517+0000 7f7cb363d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:30.518 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.517+0000 7f7cb363d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:25:30.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:30.519+0000 7f7cb363d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:25:31.064 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:31.064+0000 7f7cb363d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:31.834 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:31.833+0000 7f7cb363d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:32.612+0000 7f7cb363d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:25:33.432 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:25:33.490 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:25:33.491 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:25:33.553 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:25:33.653 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:25:33.749 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:25:33.846 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:25:33.942 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:33.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:25:34.037 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:34.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:25:34.133 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:25:34.192 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.192 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:25:34.288 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.288 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:25:34.385 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:25:34.481 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.481 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:25:34.576 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.576 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:25:34.672 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.672 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:25:34.768 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:34.768 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:25:34.805 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:34.805 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:25:34.881 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.881 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:25:34.916 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:34.916 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:25:34.991 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:25:34.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:34.995 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmSecpARAAacTj/3UdJA7q44dV1f0Ueg== 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmd/MjDhAA243KnyfIesDCnXDxLZ4wnA== 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-08-17T02:25:35.045 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmx++EFxAAqRt2Z/TOm0hrkj3weqL/7w== 2024-08-17T02:25:35.046 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2024-08-17T02:25:35.046 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQACCsBm5SQiBBAAn5fQZ+qHHSDge+zlEQhPsQ== 2024-08-17T02:25:35.046 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2024-08-17T02:25:35.046 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAFCsBmM+62ChAAYsX3TsQRKfSyr1zQrI9Gzg== 2024-08-17T02:25:35.046 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2024-08-17T02:25:35.047 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAICsBmikwMEBAAmCOC/tnXKO3vLcb4OGBOlA== 2024-08-17T02:25:35.047 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2024-08-17T02:25:35.047 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQALCsBmCwXlGRAAaoC9oGhuYnf3NX7NwI6+MA== 2024-08-17T02:25:35.047 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2024-08-17T02:25:35.047 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmC8zdBxAAJ3UyU3U4vm96pLKr79h4/w== 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmlLD8IBAARk12Zdk+4HlcMqMyzgU7qw== 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmlFRsKhAAoa6ZDgy8G3/DCHBtIYNCYQ== 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQARCsBmaFIAEhAAXV5jMiPCN7CDGDECz8ePvA== 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2024-08-17T02:25:35.048 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAUCsBm19FjFhAAPCkm2TYLgwYJnX1wb5GmTA== 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAXCsBmkgs1GhAAnbgfWEBAF+17T58NDwL/tQ== 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAaCsBmOsXYHhAAYfd/Ef3sOrc/AyKnUPWbWQ== 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmrj+TMhAAvkqX34FFpXyCVqCUadfe3A== 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD+CcBmMb+kOBAAqzd63JzfgnwKvLA/pQjl2w== 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2024-08-17T02:25:35.049 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD/CcBmlYEvAxAAbB18skMrXknjPjp9N368yQ== 2024-08-17T02:25:35.050 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2024-08-17T02:25:35.050 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQD/CcBmhGRSCRAAjt/c+ve2ZdexuMPt1Mj8vw== 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmSecpARAAacTj/3UdJA7q44dV1f0Ueg== 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmd/MjDhAA243KnyfIesDCnXDxLZ4wnA== 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmx++EFxAAqRt2Z/TOm0hrkj3weqL/7w== 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-08-17T02:25:35.084 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQACCsBm5SQiBBAAn5fQZ+qHHSDge+zlEQhPsQ== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAFCsBmM+62ChAAYsX3TsQRKfSyr1zQrI9Gzg== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAICsBmikwMEBAAmCOC/tnXKO3vLcb4OGBOlA== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQALCsBmCwXlGRAAaoC9oGhuYnf3NX7NwI6+MA== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmC8zdBxAAJ3UyU3U4vm96pLKr79h4/w== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmlLD8IBAARk12Zdk+4HlcMqMyzgU7qw== 2024-08-17T02:25:35.085 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmlFRsKhAAoa6ZDgy8G3/DCHBtIYNCYQ== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQARCsBmaFIAEhAAXV5jMiPCN7CDGDECz8ePvA== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAUCsBm19FjFhAAPCkm2TYLgwYJnX1wb5GmTA== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAXCsBmkgs1GhAAnbgfWEBAF+17T58NDwL/tQ== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAaCsBmOsXYHhAAYfd/Ef3sOrc/AyKnUPWbWQ== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmrj+TMhAAvkqX34FFpXyCVqCUadfe3A== 2024-08-17T02:25:35.086 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2024-08-17T02:25:35.087 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+CcBmMb+kOBAAqzd63JzfgnwKvLA/pQjl2w== 2024-08-17T02:25:35.087 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-08-17T02:25:35.087 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD/CcBmlYEvAxAAbB18skMrXknjPjp9N368yQ== 2024-08-17T02:25:35.087 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2024-08-17T02:25:35.087 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD/CcBmhGRSCRAAjt/c+ve2ZdexuMPt1Mj8vw== 2024-08-17T02:25:35.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:35.095 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:35.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.219 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.312 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.407 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.493 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.497 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.676 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:35.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:35.771 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:25:35.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.953 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:35.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:25:36.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.142 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.324 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:25:36.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.415 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.509 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.603 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:25:36.787 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:25:36.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:36.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:36.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:25:36.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:37.056 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:37.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:25:37.214 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:37.270 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:25:37.370 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:25:37.426 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:37.430 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:25:37.464 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:25:37.465 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:25:37.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:25:37.505 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:25:37.505 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:25:37.505 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:25:37.509 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:25:37.509 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:25:37.509 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:25:37.513 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:25:37.513 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:25:37.513 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:25:37.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:25:37.517 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:25:37.517 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:25:37.517 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:25:37.521 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:25:37.521 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:25:37.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:25:37.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.668+0000 7f3b6fc00640 1 Processor -- start 2024-08-17T02:25:37.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.668+0000 7f3b6fc00640 1 -- start start 2024-08-17T02:25:37.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6fc00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6fc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6fc00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6815d180 con 0x7f3b680c9340 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6fc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6806a580 con 0x7f3b68067700 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6fc00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b68067b50 con 0x7f3b68158d80 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:35092/0 (socket says 172.21.15.146:35092) 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b67e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 learned_addr learned my addr 172.21.15.146:0/2048507192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6dc00640 1 --1- 172.21.15.146:0/2048507192 >> v1:172.21.15.150:6789/0 conn(0x7f3b680c9340 0x7f3b68069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:44172/0 (socket says 172.21.15.146:44172) 2024-08-17T02:25:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b67e00640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 msgr2=0x7f3b6806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b67e00640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 msgr2=0x7f3b6806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 msgr2=0x7f3b6815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 msgr2=0x7f3b6815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.670+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 msgr2=0x7f3b6815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 msgr2=0x7f3b6815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.871+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.872+0000 7f3b67e00640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 msgr2=0x7f3b6806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.872+0000 7f3b67e00640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 msgr2=0x7f3b6806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.872+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.872+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:25:37.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.879+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638316297 0 0) 0x7f3b6815d180 con 0x7f3b680c9340 2024-08-17T02:25:37.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.879+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b500034e0 con 0x7f3b680c9340 2024-08-17T02:25:37.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682702927 0 0) 0x7f3b500034e0 con 0x7f3b680c9340 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 msgr2=0x7f3b6815d610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.150:3300/0 conn(0x7f3b68158d80 0x7f3b6815d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 msgr2=0x7f3b6806a040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 --2- 172.21.15.146:0/2048507192 >> v2:172.21.15.146:3300/0 conn(0x7f3b68067700 0x7f3b6806a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6806a790 con 0x7f3b680c9340 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f3b600017f0 con 0x7f3b680c9340 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 >> v1:172.21.15.150:6789/0 conn(0x7f3b680c9340 legacy=0x7f3b68069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b50003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b50004780 0x7f3b50004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b50005250 0x7f3b5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6806a580 con 0x7f3b50003aa0 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68067b50 con 0x7f3b50004780 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.883+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5000c290 con 0x7f3b50005250 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b50003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b50004780 0x7f3b50004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6dc00640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b50005250 0x7f3b5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b50005250 msgr2=0x7f3b5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b50005250 0x7f3b5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b50004780 msgr2=0x7f3b50004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b50004780 0x7f3b50004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6d200640 1 -- 172.21.15.146:0/2048507192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500034e0 con 0x7f3b50003aa0 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6dc00640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b50005250 0x7f3b5000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:37.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.884+0000 7f3b6dc00640 1 -- 172.21.15.146:0/2048507192 reap_dead start 2024-08-17T02:25:37.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.885+0000 7f3b6d200640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b50003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c006f60 tx=0x7f3b5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427aef8aa01e6853 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.886+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c033410 con 0x7f3b50003aa0 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.886+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c02d030 con 0x7f3b50003aa0 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.886+0000 7f3b67400640 1 -- 172.21.15.146:0/2048507192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0337c0 con 0x7f3b50003aa0 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 msgr2=0x7f3b50003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b50003eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c006f60 tx=0x7f3b5c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2048507192 shutdown_connections 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2048507192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b50003eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2048507192 >> 172.21.15.146:0/2048507192 conn(0x7f3b680ccc50 msgr2=0x7f3b680c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2048507192 shutdown_connections 2024-08-17T02:25:37.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.887+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2048507192 wait complete. 2024-08-17T02:25:37.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.889+0000 7f3b6fc00640 1 Processor -- start 2024-08-17T02:25:37.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.889+0000 7f3b6fc00640 1 -- start start 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b68168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 0x7f3b68097e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b680b1540 0x7f3b680b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680c7b90 con 0x7f3b50003aa0 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680b1f20 con 0x7f3b681694e0 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6fc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680986e0 con 0x7f3b680b1540 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b68168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 0x7f3b68097e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6dc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b680b1540 0x7f3b680b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b68168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47360/0 (socket says 172.21.15.146:47360) 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.890+0000 7f3b6d200640 1 -- 172.21.15.146:0/2237804223 learned_addr learned my addr 172.21.15.146:0/2237804223 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 -- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b680b1540 msgr2=0x7f3b680b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b680b1540 0x7f3b680b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 -- 172.21.15.146:0/2237804223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 msgr2=0x7f3b68168af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b68168af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 -- 172.21.15.146:0/2237804223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b680989c0 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b67e00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 0x7f3b68097e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006ea0 tx=0x7f3b54008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54010a40 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54010ba0 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54015450 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.891+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b68098ca0 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.892+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68099260 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.892+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3b54005c00 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.892+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3b54015c70 con 0x7f3b681694e0 2024-08-17T02:25:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.893+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b68071050 con 0x7f3b681694e0 2024-08-17T02:25:37.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.896+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3b54022020 con 0x7f3b681694e0 2024-08-17T02:25:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.963+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3b68063000 con 0x7f3b681694e0 2024-08-17T02:25:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.967+0000 7f3b5be00640 1 -- 172.21.15.146:0/2237804223 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3b54019030 con 0x7f3b681694e0 2024-08-17T02:25:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 msgr2=0x7f3b68097e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 0x7f3b68097e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006ea0 tx=0x7f3b54008040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 shutdown_connections 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b680b1540 0x7f3b680b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b681694e0 0x7f3b68097e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 --2- 172.21.15.146:0/2237804223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b50003aa0 0x7f3b68168af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 >> 172.21.15.146:0/2237804223 conn(0x7f3b680ccc50 msgr2=0x7f3b680ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 shutdown_connections 2024-08-17T02:25:37.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:37.968+0000 7f3b6fc00640 1 -- 172.21.15.146:0/2237804223 wait complete. 2024-08-17T02:25:37.984 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:25:37.984 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:37.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:25:38.019 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:38.018+0000 7fd22281bec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:38.045 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:38.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:25:38.141 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:38.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:25:38.178 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:38.177+0000 7fd22281bec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:38.234 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-08-17T02:25:38.234 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:25:38.240 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:38.239+0000 7fd22281bec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:38.297 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:38.297 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:25:38.354 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:38.354 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:25:38.377 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:38.377+0000 7fd570615ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:25:38.433 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:38.434 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:25:38.531 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:38.530+0000 7fd22281bec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:38.532 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-08-17T02:25:38.532 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:25:38.536 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:38.536+0000 7fd570615ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:38.583 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:38.581+0000 7fd22281bec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:38.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new c203653f-41d3-49d2-809b-9475340eb13a 0 2024-08-17T02:25:38.599 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:38.599+0000 7fd570615ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:25:38.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.744+0000 7fe68b200640 1 Processor -- start 2024-08-17T02:25:38.744 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.744+0000 7fe68b200640 1 -- start start 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe68c159b90 0x7fe68c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 0x7fe68c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68b200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0cadc0 con 0x7fe68c159f60 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68b200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0cb880 con 0x7fe68c159b90 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0cd6e0 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68a800640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe68c159f60 0x7fe68c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45138/0 (socket says 172.21.15.150:45138) 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe68a800640 1 -- 172.21.15.150:0/2734020945 learned_addr learned my addr 172.21.15.150:0/2734020945 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe689400640 1 --2- 172.21.15.150:0/2734020945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 0x7fe68c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.745+0000 7fe689e00640 1 --2- 172.21.15.150:0/2734020945 >> v2:172.21.15.146:3300/0 conn(0x7fe68c159b90 0x7fe68c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe688a00640 1 -- 172.21.15.150:0/2734020945 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532022835 0 0) 0x7fe68c0cadc0 con 0x7fe68c159f60 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe688a00640 1 -- 172.21.15.150:0/2734020945 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6700034e0 con 0x7fe68c159f60 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe689400640 1 -- 172.21.15.150:0/2734020945 >> v2:172.21.15.146:3300/0 conn(0x7fe68c159b90 msgr2=0x7fe68c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe689400640 1 --2- 172.21.15.150:0/2734020945 >> v2:172.21.15.146:3300/0 conn(0x7fe68c159b90 0x7fe68c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.747 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe689400640 1 -- 172.21.15.150:0/2734020945 >> v1:172.21.15.150:6789/0 conn(0x7fe68c159f60 legacy=0x7fe68c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.746+0000 7fe689400640 1 -- 172.21.15.150:0/2734020945 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0cb060 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.748 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.747+0000 7fe689400640 1 --2- 172.21.15.150:0/2734020945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 0x7fe68c0cc590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe6780090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b338c739df9ce1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.747+0000 7fe688a00640 1 -- 172.21.15.150:0/2734020945 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67802ad80 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.747+0000 7fe688a00640 1 -- 172.21.15.150:0/2734020945 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678032440 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.747+0000 7fe688a00640 1 -- 172.21.15.150:0/2734020945 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678032800 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 -- 172.21.15.150:0/2734020945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 msgr2=0x7fe68c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 --2- 172.21.15.150:0/2734020945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 0x7fe68c0cc590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe6780090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 -- 172.21.15.150:0/2734020945 shutdown_connections 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 --2- 172.21.15.150:0/2734020945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c0ca8a0 0x7fe68c0cc590 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 --2- 172.21.15.150:0/2734020945 >> v2:172.21.15.146:3300/0 conn(0x7fe68c159b90 0x7fe68c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 -- 172.21.15.150:0/2734020945 >> 172.21.15.150:0/2734020945 conn(0x7fe68c098e00 msgr2=0x7fe68c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 -- 172.21.15.150:0/2734020945 shutdown_connections 2024-08-17T02:25:38.749 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.748+0000 7fe68b200640 1 -- 172.21.15.150:0/2734020945 wait complete. 2024-08-17T02:25:38.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.749+0000 7fe68b200640 1 Processor -- start 2024-08-17T02:25:38.750 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.749+0000 7fe68b200640 1 -- start start 2024-08-17T02:25:38.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 0x7fe68c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.752 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c159f60 0x7fe68c09b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0c5080 con 0x7fe68c0ca8a0 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0c5360 con 0x7fe68c159b90 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.750+0000 7fe68b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0c5640 con 0x7fe68c159f60 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45732/0 (socket says 172.21.15.150:45732) 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 -- 172.21.15.150:0/3127208011 learned_addr learned my addr 172.21.15.150:0/3127208011 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe68a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c159f60 0x7fe68c09b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689e00640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 0x7fe68c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 -- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c159f60 msgr2=0x7fe68c09b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c159f60 0x7fe68c09b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 -- 172.21.15.150:0/3127208011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 msgr2=0x7fe68c155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 0x7fe68c155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.753 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 -- 172.21.15.150:0/3127208011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678009390 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689e00640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 0x7fe68c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.751+0000 7fe689400640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe678032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678031830 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678031990 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678031d70 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c09b490 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c0c66e0 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe67803e8f0 con 0x7fe68c159b90 2024-08-17T02:25:38.754 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.752+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe67803c750 con 0x7fe68c159b90 2024-08-17T02:25:38.755 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.753+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c09b680 con 0x7fe68c159b90 2024-08-17T02:25:38.756 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.755+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe67804c060 con 0x7fe68c159b90 2024-08-17T02:25:38.830 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.829+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c203653f-41d3-49d2-809b-9475340eb13a", "id": 0} v 0) v1 -- 0x7fe68c0c6870 con 0x7fe68c159b90 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.836+0000 7fe681600640 1 -- 172.21.15.150:0/3127208011 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c203653f-41d3-49d2-809b-9475340eb13a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe678043070 con 0x7fe68c159b90 2024-08-17T02:25:38.836 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.837+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 msgr2=0x7fe68c0c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.837+0000 7fe68b200640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe678009850 tx=0x7fe678032000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 shutdown_connections 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe68c159f60 0x7fe68c09b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.838 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe68c159b90 0x7fe68c0c46c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 --2- 172.21.15.150:0/3127208011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe68c0ca8a0 0x7fe68c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 >> 172.21.15.150:0/3127208011 conn(0x7fe68c098e00 msgr2=0x7fe68c0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 shutdown_connections 2024-08-17T02:25:38.839 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:38.838+0000 7fe68b200640 1 -- 172.21.15.150:0/3127208011 wait complete. 2024-08-17T02:25:38.854 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 8cc3b7ae-3662-4943-b073-9f77001ed5a4 1 2024-08-17T02:25:38.916 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:38.916+0000 7fd570615ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:25:38.969 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:38.969+0000 7fd570615ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:25:39.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.002+0000 7f8367000640 1 Processor -- start 2024-08-17T02:25:39.002 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.002+0000 7f8367000640 1 -- start start 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.003+0000 7f8367000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83600ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.003+0000 7f8367000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83600ae150 con 0x7f83600adcf0 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f8367000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836015b030 con 0x7f8360156990 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f8367000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600cc2e0 con 0x7f8360156d60 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f835fe00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8360156990 0x7f83600b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45140/0 (socket says 172.21.15.150:45140) 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f835fe00640 1 -- 172.21.15.150:0/2772735439 learned_addr learned my addr 172.21.15.150:0/2772735439 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f835f400640 1 --2- 172.21.15.150:0/2772735439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83600ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.004+0000 7f835ea00640 1 -- 172.21.15.150:0/2772735439 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825240876 0 0) 0x7f836015b030 con 0x7f8360156990 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.005+0000 7f835ea00640 1 -- 172.21.15.150:0/2772735439 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83440034e0 con 0x7f8360156990 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.005+0000 7f835f400640 1 -- 172.21.15.150:0/2772735439 >> v1:172.21.15.150:6789/0 conn(0x7f8360156990 legacy=0x7f83600b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.005+0000 7f835f400640 1 -- 172.21.15.150:0/2772735439 >> v1:172.21.15.146:6789/0 conn(0x7f83600adcf0 legacy=0x7f83600ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.005+0000 7f835f400640 1 -- 172.21.15.150:0/2772735439 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600b1110 con 0x7f8360156d60 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.006+0000 7f835f400640 1 --2- 172.21.15.150:0/2772735439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83600ad7b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f834c009880 tx=0x7f834c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d93fd9de79ba79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.006+0000 7f835ea00640 1 -- 172.21.15.150:0/2772735439 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c02ae10 con 0x7f8360156d60 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.006+0000 7f835ea00640 1 -- 172.21.15.150:0/2772735439 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c032440 con 0x7f8360156d60 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.006+0000 7f835ea00640 1 -- 172.21.15.150:0/2772735439 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0327e0 con 0x7f8360156d60 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 -- 172.21.15.150:0/2772735439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 msgr2=0x7f83600ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 --2- 172.21.15.150:0/2772735439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83600ad7b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f834c009880 tx=0x7f834c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 -- 172.21.15.150:0/2772735439 shutdown_connections 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 --2- 172.21.15.150:0/2772735439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83600ad7b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 -- 172.21.15.150:0/2772735439 >> 172.21.15.150:0/2772735439 conn(0x7f8360067750 msgr2=0x7f83600cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 -- 172.21.15.150:0/2772735439 shutdown_connections 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.007+0000 7f8367000640 1 -- 172.21.15.150:0/2772735439 wait complete. 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.008+0000 7f8367000640 1 Processor -- start 2024-08-17T02:25:39.009 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.008+0000 7f8367000640 1 -- start start 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83600adcf0 0x7f83601577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83601542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8360155360 con 0x7f83600adcf0 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601592d0 con 0x7f8360156990 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.009+0000 7f8367000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8360159870 con 0x7f8360156d60 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f835f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83601542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f835f400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45736/0 (socket says 172.21.15.150:45736) 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f835f400640 1 -- 172.21.15.150:0/983428639 learned_addr learned my addr 172.21.15.150:0/983428639 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f835fe00640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83600adcf0 0x7f83601577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 -- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 msgr2=0x7f8360159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.011 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 -- 172.21.15.150:0/983428639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83600adcf0 msgr2=0x7f83601577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83600adcf0 0x7f83601577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 -- 172.21.15.150:0/983428639 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009390 con 0x7f8360156d60 2024-08-17T02:25:39.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f835f400640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.012 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.010+0000 7f8365000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83601542e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f835800c790 tx=0x7f8358001610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800a640 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835800a7a0 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800ab60 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8360154da0 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8360159500 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8358012420 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.011+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f835801b7c0 con 0x7f8360156d60 2024-08-17T02:25:39.013 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.012+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83601599e0 con 0x7f8360156d60 2024-08-17T02:25:39.015 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.014+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f83600ae150 con 0x7f8360156d60 2024-08-17T02:25:39.090 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.089+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8cc3b7ae-3662-4943-b073-9f77001ed5a4", "id": 1} v 0) v1 -- 0x7f8360071050 con 0x7f8360156d60 2024-08-17T02:25:39.098 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.097+0000 7f8357400640 1 -- 172.21.15.150:0/983428639 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8cc3b7ae-3662-4943-b073-9f77001ed5a4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8358012900 con 0x7f8360156d60 2024-08-17T02:25:39.098 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-08-17T02:25:39.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.098+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 msgr2=0x7f83601542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.098+0000 7f8367000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83601542e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f835800c790 tx=0x7f8358001610 comp rx=0 tx=0).stop 2024-08-17T02:25:39.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 shutdown_connections 2024-08-17T02:25:39.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8360156d60 0x7f83601542e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.099 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8360156990 0x7f8360159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 --2- 172.21.15.150:0/983428639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83600adcf0 0x7f83601577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 >> 172.21.15.150:0/983428639 conn(0x7f8360067750 msgr2=0x7f8360152590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 shutdown_connections 2024-08-17T02:25:39.100 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.099+0000 7f8367000640 1 -- 172.21.15.150:0/983428639 wait complete. 2024-08-17T02:25:39.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 685a41c6-c583-4ca3-a279-b7b9c74fba7c 2 2024-08-17T02:25:39.259 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.259+0000 7f3ad1000640 1 Processor -- start 2024-08-17T02:25:39.260 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.259+0000 7f3ad1000640 1 -- start start 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ad1000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3acc158ea0 0x7f3acc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ad1000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc06f240 con 0x7f3acc0caa00 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ad1000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc0cf410 con 0x7f3acc0d09a0 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ad1000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0c6f20 con 0x7f3acc158ea0 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ac9e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3acc158ea0 0x7f3acc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ac9400640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3acc0d09a0 0x7f3acc0ca2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45142/0 (socket says 172.21.15.150:45142) 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ac9400640 1 -- 172.21.15.150:0/2529918103 learned_addr learned my addr 172.21.15.150:0/2529918103 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:39.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.260+0000 7f3ac9e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3acc158ea0 0x7f3acc0d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45740/0 (socket says 172.21.15.150:45740) 2024-08-17T02:25:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.261+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2529918103 >> v1:172.21.15.150:6789/0 conn(0x7f3acc0d09a0 legacy=0x7f3acc0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.261+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2529918103 >> v1:172.21.15.146:6789/0 conn(0x7f3acc0caa00 legacy=0x7f3acc0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.261+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2529918103 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0ceb70 con 0x7f3acc158ea0 2024-08-17T02:25:39.262 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.262+0000 7f3ac9e00640 1 --2- 172.21.15.150:0/2529918103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc158ea0 0x7f3acc0d0460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009850 tx=0x7f3abc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972512cd2958fe7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.262+0000 7f3ac8a00640 1 -- 172.21.15.150:0/2529918103 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc02ad90 con 0x7f3acc158ea0 2024-08-17T02:25:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.262+0000 7f3ac8a00640 1 -- 172.21.15.150:0/2529918103 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc032440 con 0x7f3acc158ea0 2024-08-17T02:25:39.263 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.262+0000 7f3ac8a00640 1 -- 172.21.15.150:0/2529918103 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc032820 con 0x7f3acc158ea0 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 -- 172.21.15.150:0/2529918103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc158ea0 msgr2=0x7f3acc0d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2529918103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc158ea0 0x7f3acc0d0460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009850 tx=0x7f3abc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 -- 172.21.15.150:0/2529918103 shutdown_connections 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2529918103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc158ea0 0x7f3acc0d0460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 -- 172.21.15.150:0/2529918103 >> 172.21.15.150:0/2529918103 conn(0x7f3acc06eb90 msgr2=0x7f3acc0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 -- 172.21.15.150:0/2529918103 shutdown_connections 2024-08-17T02:25:39.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.263+0000 7f3ad1000640 1 -- 172.21.15.150:0/2529918103 wait complete. 2024-08-17T02:25:39.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.265+0000 7f3ad1000640 1 Processor -- start 2024-08-17T02:25:39.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.266+0000 7f3ad1000640 1 -- start start 2024-08-17T02:25:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0d09a0 0x7f3acc09d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3acc158ea0 0x7f3acc09a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc09cfa0 con 0x7f3acc158ea0 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc09c390 con 0x7f3acc0caa00 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ad1000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc09c670 con 0x7f3acc0d09a0 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ac9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45748/0 (socket says 172.21.15.150:45748) 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ac9400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0d09a0 0x7f3acc09d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2265863704 learned_addr learned my addr 172.21.15.150:0/2265863704 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.267+0000 7f3aca800640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3acc158ea0 0x7f3acc09a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0d09a0 msgr2=0x7f3acc09d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0d09a0 0x7f3acc09d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2265863704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3acc158ea0 msgr2=0x7f3acc09a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3acc158ea0 0x7f3acc09a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 -- 172.21.15.150:0/2265863704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009390 con 0x7f3acc0caa00 2024-08-17T02:25:39.269 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac9e00640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009360 tx=0x7f3abc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc031de0 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc03d420 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc03d7e0 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.268+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc09c950 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.269+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc09d970 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.269+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3abc039040 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.269+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f3abc03dde0 con 0x7f3acc0caa00 2024-08-17T02:25:39.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.270+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc071050 con 0x7f3acc0caa00 2024-08-17T02:25:39.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.272+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3abc042070 con 0x7f3acc0caa00 2024-08-17T02:25:39.346 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.346+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "685a41c6-c583-4ca3-a279-b7b9c74fba7c", "id": 2} v 0) v1 -- 0x7f3acc0cf600 con 0x7f3acc0caa00 2024-08-17T02:25:39.354 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.354+0000 7f3ac1600640 1 -- 172.21.15.150:0/2265863704 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "685a41c6-c583-4ca3-a279-b7b9c74fba7c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3abc037070 con 0x7f3acc0caa00 2024-08-17T02:25:39.355 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-08-17T02:25:39.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.355+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 msgr2=0x7f3acc0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.355+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009360 tx=0x7f3abc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:39.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 shutdown_connections 2024-08-17T02:25:39.356 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3acc158ea0 0x7f3acc09a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3acc0d09a0 0x7f3acc09d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 --2- 172.21.15.150:0/2265863704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3acc0caa00 0x7f3acc0b1ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 >> 172.21.15.150:0/2265863704 conn(0x7f3acc06eb90 msgr2=0x7f3acc068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 shutdown_connections 2024-08-17T02:25:39.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.356+0000 7f3ad1000640 1 -- 172.21.15.150:0/2265863704 wait complete. 2024-08-17T02:25:39.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new a81ab657-5c27-4d75-b42f-d35337c645ee 3 2024-08-17T02:25:39.429 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.428+0000 7fd22281bec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:39.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.517+0000 7f8769200640 1 Processor -- start 2024-08-17T02:25:39.517 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.517+0000 7f8769200640 1 -- start start 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8769200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87640ce050 0x7f87640cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8769200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640cd190 con 0x7f8764159aa0 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8769200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640cad60 con 0x7f87640ccd30 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8769200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640c4b90 con 0x7f87640ce050 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8762a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87640ce050 0x7f87640cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8762a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f87640ce050 0x7f87640cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45754/0 (socket says 172.21.15.150:45754) 2024-08-17T02:25:39.519 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.518+0000 7f8762a00640 1 -- 172.21.15.150:0/4024825351 learned_addr learned my addr 172.21.15.150:0/4024825351 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.519+0000 7f8762a00640 1 -- 172.21.15.150:0/4024825351 >> v1:172.21.15.150:6789/0 conn(0x7f87640ccd30 legacy=0x7f87641629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.519+0000 7f8762a00640 1 -- 172.21.15.150:0/4024825351 >> v1:172.21.15.146:6789/0 conn(0x7f8764159aa0 legacy=0x7f8764159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.519+0000 7f8762000640 1 -- 172.21.15.150:0/4024825351 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108172530 0 0) 0x7f87640cad60 con 0x7f87640ccd30 2024-08-17T02:25:39.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.519+0000 7f8762a00640 1 -- 172.21.15.150:0/4024825351 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876415a580 con 0x7f87640ce050 2024-08-17T02:25:39.520 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.520+0000 7f8762a00640 1 --2- 172.21.15.150:0/4024825351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ce050 0x7f87640cc7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8750009910 tx=0x7f87500091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410df3d771d0ca79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.520+0000 7f8762000640 1 -- 172.21.15.150:0/4024825351 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875002ad30 con 0x7f87640ce050 2024-08-17T02:25:39.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.520+0000 7f8762000640 1 -- 172.21.15.150:0/4024825351 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875002ae90 con 0x7f87640ce050 2024-08-17T02:25:39.521 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.520+0000 7f8762000640 1 -- 172.21.15.150:0/4024825351 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750032670 con 0x7f87640ce050 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 -- 172.21.15.150:0/4024825351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ce050 msgr2=0x7f87640cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 --2- 172.21.15.150:0/4024825351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ce050 0x7f87640cc7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8750009910 tx=0x7f87500091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 -- 172.21.15.150:0/4024825351 shutdown_connections 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 --2- 172.21.15.150:0/4024825351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ce050 0x7f87640cc7f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 -- 172.21.15.150:0/4024825351 >> 172.21.15.150:0/4024825351 conn(0x7f8764099040 msgr2=0x7f876406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 -- 172.21.15.150:0/4024825351 shutdown_connections 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.521+0000 7f8769200640 1 -- 172.21.15.150:0/4024825351 wait complete. 2024-08-17T02:25:39.522 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.522+0000 7f8769200640 1 Processor -- start 2024-08-17T02:25:39.523 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.522+0000 7f8769200640 1 -- start start 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87640ce050 0x7f87640b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8764159aa0 0x7f8764067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764099a20 con 0x7f8764159aa0 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b3ae0 con 0x7f87640ccd30 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8769200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b4990 con 0x7f87640ce050 2024-08-17T02:25:39.525 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8763400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8763400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45760/0 (socket says 172.21.15.150:45760) 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8763400640 1 -- 172.21.15.150:0/2263080191 learned_addr learned my addr 172.21.15.150:0/2263080191 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.523+0000 7f8762a00640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87640ce050 0x7f87640b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763e00640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8764159aa0 0x7f8764067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 -- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87640ce050 msgr2=0x7f87640b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87640ce050 0x7f87640b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 -- 172.21.15.150:0/2263080191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8764159aa0 msgr2=0x7f8764067bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8764159aa0 0x7f8764067bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 -- 172.21.15.150:0/2263080191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750009450 con 0x7f87640ccd30 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8763400640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f875400c810 tx=0x7f8754007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.526 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400ce00 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875400a850 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640b3d10 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.524+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400ac50 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.525+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87640b45b0 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.525+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8754012630 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.525+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f875400adb0 con 0x7f87640ccd30 2024-08-17T02:25:39.527 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.526+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8764071050 con 0x7f87640ccd30 2024-08-17T02:25:39.528 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.527+0000 7fd22281bec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:39.528 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.528+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f87640cd190 con 0x7f87640ccd30 2024-08-17T02:25:39.578 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.577+0000 7fd22281bec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:39.603 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.603+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a81ab657-5c27-4d75-b42f-d35337c645ee", "id": 3} v 0) v1 -- 0x7f876406f480 con 0x7f87640ccd30 2024-08-17T02:25:39.610 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.610+0000 7f875aa00640 1 -- 172.21.15.150:0/2263080191 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a81ab657-5c27-4d75-b42f-d35337c645ee", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8754012980 con 0x7f87640ccd30 2024-08-17T02:25:39.611 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-08-17T02:25:39.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 msgr2=0x7f87640c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.611 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f875400c810 tx=0x7f8754007eb0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 shutdown_connections 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8764159aa0 0x7f8764067bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f87640ce050 0x7f87640b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 --2- 172.21.15.150:0/2263080191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87640ccd30 0x7f87640c8ec0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 >> 172.21.15.150:0/2263080191 conn(0x7f8764099040 msgr2=0x7f87640b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 shutdown_connections 2024-08-17T02:25:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.611+0000 7f8769200640 1 -- 172.21.15.150:0/2263080191 wait complete. 2024-08-17T02:25:39.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4 4 2024-08-17T02:25:39.745 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.744+0000 7fd22281bec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:39.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.774+0000 7f19af200640 1 Processor -- start 2024-08-17T02:25:39.774 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.774+0000 7f19af200640 1 -- start start 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.775+0000 7f19af200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 0x7f19b00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.775+0000 7f19af200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19b00ccd30 0x7f19b01629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.775+0000 7f19af200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b00cd190 con 0x7f19b0159aa0 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.775+0000 7f19af200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b00cad60 con 0x7f19b00ce050 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.775+0000 7f19af200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b00c4b90 con 0x7f19b00ccd30 2024-08-17T02:25:39.776 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19b00ccd30 0x7f19b01629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19a7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 0x7f19b00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19b00ccd30 0x7f19b01629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45762/0 (socket says 172.21.15.150:45762) 2024-08-17T02:25:39.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 -- 172.21.15.150:0/2983231903 learned_addr learned my addr 172.21.15.150:0/2983231903 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 -- 172.21.15.150:0/2983231903 >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 msgr2=0x7f19b00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 --2- 172.21.15.150:0/2983231903 >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 0x7f19b00cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 -- 172.21.15.150:0/2983231903 >> v1:172.21.15.146:6789/0 conn(0x7f19b0159aa0 legacy=0x7f19b0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19ae800640 1 -- 172.21.15.150:0/2983231903 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b015a580 con 0x7f19b00ccd30 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.776+0000 7f19a7e00640 1 --2- 172.21.15.150:0/2983231903 >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 0x7f19b00cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.777+0000 7f19ae800640 1 --2- 172.21.15.150:0/2983231903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b01629f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19b0089170 tx=0x7f19a8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ca01cab550212e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.777+0000 7f19ad400640 1 -- 172.21.15.150:0/2983231903 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a802e050 con 0x7f19b00ccd30 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.777+0000 7f19ad400640 1 -- 172.21.15.150:0/2983231903 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8007400 con 0x7f19b00ccd30 2024-08-17T02:25:39.778 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.777+0000 7f19ad400640 1 -- 172.21.15.150:0/2983231903 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80077e0 con 0x7f19b00ccd30 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 -- 172.21.15.150:0/2983231903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 msgr2=0x7f19b01629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 --2- 172.21.15.150:0/2983231903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b01629f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19b0089170 tx=0x7f19a8009840 comp rx=0 tx=0).stop 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 -- 172.21.15.150:0/2983231903 shutdown_connections 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 --2- 172.21.15.150:0/2983231903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b01629f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 --2- 172.21.15.150:0/2983231903 >> v2:172.21.15.146:3300/0 conn(0x7f19b00ce050 0x7f19b00cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.779 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 -- 172.21.15.150:0/2983231903 >> 172.21.15.150:0/2983231903 conn(0x7f19b0099040 msgr2=0x7f19b006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 -- 172.21.15.150:0/2983231903 shutdown_connections 2024-08-17T02:25:39.780 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.778+0000 7f19af200640 1 -- 172.21.15.150:0/2983231903 wait complete. 2024-08-17T02:25:39.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.780+0000 7f19af200640 1 Processor -- start 2024-08-17T02:25:39.781 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.781+0000 7f19af200640 1 -- start start 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b0148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19b0159aa0 0x7f19b00b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00c8370 con 0x7f19b00ce050 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00c7a80 con 0x7f19b00ccd30 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19af200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0148ed0 con 0x7f19b0159aa0 2024-08-17T02:25:39.784 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.150:33540/0 (socket says 172.21.15.150:33540) 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19ade00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b0148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19a7e00640 1 -- 172.21.15.150:0/2537366282 learned_addr learned my addr 172.21.15.150:0/2537366282 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.782+0000 7f19ae800640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19b0159aa0 0x7f19b00b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 -- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19b0159aa0 msgr2=0x7f19b00b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19b0159aa0 0x7f19b00b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 -- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 msgr2=0x7f19b0148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b0148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 -- 172.21.15.150:0/2537366282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009390 con 0x7f19b00ce050 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a7e00640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f199800ec80 tx=0x7f19980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199800eec0 con 0x7f19b00ce050 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199800cbc0 con 0x7f19b00ce050 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a8009ae0 con 0x7f19b00ce050 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.783+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998013470 con 0x7f19b00ce050 2024-08-17T02:25:39.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.784+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b00c8000 con 0x7f19b00ce050 2024-08-17T02:25:39.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.784+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1998005970 con 0x7f19b00ce050 2024-08-17T02:25:39.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.784+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f1998005c20 con 0x7f19b00ce050 2024-08-17T02:25:39.786 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.785+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b0071050 con 0x7f19b00ce050 2024-08-17T02:25:39.788 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.787+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1998021060 con 0x7f19b00ce050 2024-08-17T02:25:39.815 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.814+0000 7fd22281bec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:39.848 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:39.848+0000 7fd570615ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:25:39.862 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.861+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4", "id": 4} v 0) v1 -- 0x7f19b006f480 con 0x7f19b00ce050 2024-08-17T02:25:39.867 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.866+0000 7f19a5600640 1 -- 172.21.15.150:0/2537366282 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1998029020 con 0x7f19b00ce050 2024-08-17T02:25:39.867 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-08-17T02:25:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 msgr2=0x7f19b00b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f199800ec80 tx=0x7f19980090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 shutdown_connections 2024-08-17T02:25:39.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b00ce050 0x7f19b00b3b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19b0159aa0 0x7f19b00b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 --2- 172.21.15.150:0/2537366282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19b00ccd30 0x7f19b0148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 >> 172.21.15.150:0/2537366282 conn(0x7f19b0099040 msgr2=0x7f19b00c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 shutdown_connections 2024-08-17T02:25:39.869 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:39.868+0000 7f19af200640 1 -- 172.21.15.150:0/2537366282 wait complete. 2024-08-17T02:25:39.875 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.874+0000 7fd22281bec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:39.882 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 30780f03-2e7f-47ac-9713-af35f283e12b 5 2024-08-17T02:25:39.955 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:39.954+0000 7fd570615ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:39.983 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:39.983+0000 7fd22281bec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:40.006 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.005+0000 7fd570615ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:25:40.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.027+0000 7f38cee00640 1 Processor -- start 2024-08-17T02:25:40.028 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.027+0000 7f38cee00640 1 -- start start 2024-08-17T02:25:40.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cee00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38c80ca770 0x7f38c80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c806f240 con 0x7f38c80ca2f0 2024-08-17T02:25:40.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cee00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80cf410 con 0x7f38c8158ea0 2024-08-17T02:25:40.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cee00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80c6f20 con 0x7f38c80ca770 2024-08-17T02:25:40.029 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38c7e00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f38c8158ea0 0x7f38c80d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45154/0 (socket says 172.21.15.150:45154) 2024-08-17T02:25:40.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38c7e00640 1 -- 172.21.15.150:0/2074137770 learned_addr learned my addr 172.21.15.150:0/2074137770 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:40.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cce00640 1 --2- 172.21.15.150:0/2074137770 >> v2:172.21.15.150:3300/0 conn(0x7f38c80ca770 0x7f38c80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066556904 0 0) 0x7f38c80cf410 con 0x7f38c8158ea0 2024-08-17T02:25:40.030 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38ac0034e0 con 0x7f38c8158ea0 2024-08-17T02:25:40.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452088163 0 0) 0x7f38c806f240 con 0x7f38c80ca2f0 2024-08-17T02:25:40.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cce00640 1 -- 172.21.15.150:0/2074137770 >> v1:172.21.15.150:6789/0 conn(0x7f38c8158ea0 legacy=0x7f38c80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cce00640 1 -- 172.21.15.150:0/2074137770 >> v1:172.21.15.146:6789/0 conn(0x7f38c80ca2f0 legacy=0x7f38c80c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.029+0000 7f38cce00640 1 -- 172.21.15.150:0/2074137770 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80d0b70 con 0x7f38c80ca770 2024-08-17T02:25:40.031 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.031+0000 7f38cce00640 1 --2- 172.21.15.150:0/2074137770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c80ca770 0x7f38c80c7a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e60 tx=0x7f38c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769b557845a5203d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.031+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0007550 con 0x7f38c80ca770 2024-08-17T02:25:40.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.031+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c002d050 con 0x7f38c80ca770 2024-08-17T02:25:40.032 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.031+0000 7f38c6a00640 1 -- 172.21.15.150:0/2074137770 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00078e0 con 0x7f38c80ca770 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 -- 172.21.15.150:0/2074137770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c80ca770 msgr2=0x7f38c80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 --2- 172.21.15.150:0/2074137770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c80ca770 0x7f38c80c7a80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e60 tx=0x7f38c0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 -- 172.21.15.150:0/2074137770 shutdown_connections 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 --2- 172.21.15.150:0/2074137770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c80ca770 0x7f38c80c7a80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 -- 172.21.15.150:0/2074137770 >> 172.21.15.150:0/2074137770 conn(0x7f38c806eb90 msgr2=0x7f38c80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 -- 172.21.15.150:0/2074137770 shutdown_connections 2024-08-17T02:25:40.033 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.032+0000 7f38cee00640 1 -- 172.21.15.150:0/2074137770 wait complete. 2024-08-17T02:25:40.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.033+0000 7f38cee00640 1 Processor -- start 2024-08-17T02:25:40.034 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 -- start start 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 0x7f38c8155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c8158ea0 0x7f38c81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b3510 con 0x7f38c80ca2f0 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b37f0 con 0x7f38c8158ea0 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.034+0000 7f38cee00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b3ad0 con 0x7f38c80ca770 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38cce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c8158ea0 0x7f38c81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 0x7f38c8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60150/0 (socket says 172.21.15.150:60150) 2024-08-17T02:25:40.036 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 0x7f38c8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.150:33552/0 (socket says 172.21.15.150:33552) 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 -- 172.21.15.150:0/3101193584 learned_addr learned my addr 172.21.15.150:0/3101193584 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 -- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c8158ea0 msgr2=0x7f38c81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c8158ea0 0x7f38c81569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 -- 172.21.15.150:0/3101193584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 msgr2=0x7f38c8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 0x7f38c8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.035+0000 7f38c7400640 1 -- 172.21.15.150:0/3101193584 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009a20 con 0x7f38c80ca770 2024-08-17T02:25:40.037 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38c7400640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4e0 tx=0x7f38b4007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4011590 con 0x7f38c80ca770 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40116f0 con 0x7f38c80ca770 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4011af0 con 0x7f38c80ca770 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80b3db0 con 0x7f38c80ca770 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c81555a0 con 0x7f38c80ca770 2024-08-17T02:25:40.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f38b401c440 con 0x7f38c80ca770 2024-08-17T02:25:40.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.036+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f38b4012420 con 0x7f38c80ca770 2024-08-17T02:25:40.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.037+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c80b42b0 con 0x7f38c80ca770 2024-08-17T02:25:40.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.039+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f38b4017070 con 0x7f38c80ca770 2024-08-17T02:25:40.114 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.113+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "30780f03-2e7f-47ac-9713-af35f283e12b", "id": 5} v 0) v1 -- 0x7f38c8071050 con 0x7f38c80ca770 2024-08-17T02:25:40.122 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.121+0000 7f38bf400640 1 -- 172.21.15.150:0/3101193584 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30780f03-2e7f-47ac-9713-af35f283e12b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f38b401c6f0 con 0x7f38c80ca770 2024-08-17T02:25:40.122 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 msgr2=0x7f38c8168ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4e0 tx=0x7f38b4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 shutdown_connections 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38c8158ea0 0x7f38c81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.123 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38c80ca770 0x7f38c8168ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 --2- 172.21.15.150:0/3101193584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c80ca2f0 0x7f38c8155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 >> 172.21.15.150:0/3101193584 conn(0x7f38c806eb90 msgr2=0x7f38c8158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 shutdown_connections 2024-08-17T02:25:40.124 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.122+0000 7f38cee00640 1 -- 172.21.15.150:0/3101193584 wait complete. 2024-08-17T02:25:40.137 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 2a34e0eb-8c44-4bf6-aa4e-0462ae778110 6 2024-08-17T02:25:40.185 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.185+0000 7fd570615ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:25:40.246 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.246+0000 7fd570615ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:25:40.281 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.281+0000 7fd8b2200640 1 Processor -- start 2024-08-17T02:25:40.282 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.281+0000 7fd8b2200640 1 -- start start 2024-08-17T02:25:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.282+0000 7fd8b2200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.282+0000 7fd8b2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8ac0ae0d0 0x7fd8ac0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.282+0000 7fd8b2200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0b11d0 con 0x7fd8ac159200 2024-08-17T02:25:40.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.282+0000 7fd8b2200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b0650 con 0x7fd8ac0ae0d0 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.282+0000 7fd8b2200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b08a0 con 0x7fd8ac0d0490 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aaa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8ab400640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd8ac159200 0x7fd8ac0ad9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45162/0 (socket says 172.21.15.150:45162) 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8ab400640 1 -- 172.21.15.150:0/1221344724 learned_addr learned my addr 172.21.15.150:0/1221344724 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8abe00640 1 --2- 172.21.15.150:0/1221344724 >> v2:172.21.15.146:3300/0 conn(0x7fd8ac0ae0d0 0x7fd8ac0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.286 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aa000640 1 -- 172.21.15.150:0/1221344724 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510806946 0 0) 0x7fd8ac0b11d0 con 0x7fd8ac159200 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aa000640 1 -- 172.21.15.150:0/1221344724 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8900034e0 con 0x7fd8ac159200 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aaa00640 1 -- 172.21.15.150:0/1221344724 >> v2:172.21.15.146:3300/0 conn(0x7fd8ac0ae0d0 msgr2=0x7fd8ac0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aaa00640 1 --2- 172.21.15.150:0/1221344724 >> v2:172.21.15.146:3300/0 conn(0x7fd8ac0ae0d0 0x7fd8ac0b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aaa00640 1 -- 172.21.15.150:0/1221344724 >> v1:172.21.15.150:6789/0 conn(0x7fd8ac159200 legacy=0x7fd8ac0ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.283+0000 7fd8aaa00640 1 -- 172.21.15.150:0/1221344724 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0b0b80 con 0x7fd8ac0d0490 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.284+0000 7fd8aaa00640 1 --2- 172.21.15.150:0/1221344724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac0aeeb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd898009880 tx=0x7fd8980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef589f670933906b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.284+0000 7fd8aa000640 1 -- 172.21.15.150:0/1221344724 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89802ae00 con 0x7fd8ac0d0490 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8aa000640 1 -- 172.21.15.150:0/1221344724 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898032440 con 0x7fd8ac0d0490 2024-08-17T02:25:40.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8aa000640 1 -- 172.21.15.150:0/1221344724 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898032800 con 0x7fd8ac0d0490 2024-08-17T02:25:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 -- 172.21.15.150:0/1221344724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 msgr2=0x7fd8ac0aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 --2- 172.21.15.150:0/1221344724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac0aeeb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd898009880 tx=0x7fd8980090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 -- 172.21.15.150:0/1221344724 shutdown_connections 2024-08-17T02:25:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 --2- 172.21.15.150:0/1221344724 >> v2:172.21.15.146:3300/0 conn(0x7fd8ac0ae0d0 0x7fd8ac0b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.291 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 --2- 172.21.15.150:0/1221344724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac0aeeb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 -- 172.21.15.150:0/1221344724 >> 172.21.15.150:0/1221344724 conn(0x7fd8ac06eb90 msgr2=0x7fd8ac0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 -- 172.21.15.150:0/1221344724 shutdown_connections 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.285+0000 7fd8b2200640 1 -- 172.21.15.150:0/1221344724 wait complete. 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.287+0000 7fd8b2200640 1 Processor -- start 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.287+0000 7fd8b2200640 1 -- start start 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8ac159200 0x7fd8ac0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac145d10 con 0x7fd8ac159200 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac168b90 con 0x7fd8ac0ae0d0 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8b2200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac168e50 con 0x7fd8ac0d0490 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8ab400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60180/0 (socket says 172.21.15.150:60180) 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8ab400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45796/0 (socket says 172.21.15.150:45796) 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 -- 172.21.15.150:0/285981929 learned_addr learned my addr 172.21.15.150:0/285981929 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8abe00640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8ac159200 0x7fd8ac0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 -- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 msgr2=0x7fd8ac1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 -- 172.21.15.150:0/285981929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8ac159200 msgr2=0x7fd8ac0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.288+0000 7fd8aaa00640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8ac159200 0x7fd8ac0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8aaa00640 1 -- 172.21.15.150:0/285981929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd898009390 con 0x7fd8ac0d0490 2024-08-17T02:25:40.293 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8ab400640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8aaa00640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd898009360 tx=0x7fd898032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898031800 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898031960 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd898031d00 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac169130 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac1696f0 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.289+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd89803e8f0 con 0x7fd8ac0d0490 2024-08-17T02:25:40.294 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.290+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd89803eba0 con 0x7fd8ac0d0490 2024-08-17T02:25:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.290+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac071050 con 0x7fd8ac0d0490 2024-08-17T02:25:40.295 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.294+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd898043070 con 0x7fd8ac0d0490 2024-08-17T02:25:40.311 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.310+0000 7fd570615ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:25:40.367 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.367+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2a34e0eb-8c44-4bf6-aa4e-0462ae778110", "id": 6} v 0) v1 -- 0x7fd8ac156910 con 0x7fd8ac0d0490 2024-08-17T02:25:40.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.374+0000 7fd8a2a00640 1 -- 172.21.15.150:0/285981929 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a34e0eb-8c44-4bf6-aa4e-0462ae778110", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd898037070 con 0x7fd8ac0d0490 2024-08-17T02:25:40.375 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-08-17T02:25:40.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 msgr2=0x7fd8ac154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd898009360 tx=0x7fd898032000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 shutdown_connections 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8ac159200 0x7fd8ac0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ac0d0490 0x7fd8ac154820 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 --2- 172.21.15.150:0/285981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ac0ae0d0 0x7fd8ac1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.375+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 >> 172.21.15.150:0/285981929 conn(0x7fd8ac06eb90 msgr2=0x7fd8ac14e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.376+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 shutdown_connections 2024-08-17T02:25:40.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.376+0000 7fd8b2200640 1 -- 172.21.15.150:0/285981929 wait complete. 2024-08-17T02:25:40.391 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 3d68d8c4-565a-4b04-8d1b-7bb663bafa5e 7 2024-08-17T02:25:40.423 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.422+0000 7fd570615ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:25:40.436 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:40.435+0000 7fd22281bec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:25:40.536 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.536+0000 7f81ed200640 1 Processor -- start 2024-08-17T02:25:40.537 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.536+0000 7f81ed200640 1 -- start start 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.537+0000 7f81ed200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81e8159200 0x7f81e80aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.537+0000 7f81ed200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b11d0 con 0x7f81e80ae0d0 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.537+0000 7f81ed200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b0650 con 0x7f81e80d0490 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.537+0000 7f81ed200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80b08a0 con 0x7f81e8159200 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.537+0000 7f81e5400640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f81e80d0490 0x7f81e80ad9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:45176/0 (socket says 172.21.15.150:45176) 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e5400640 1 -- 172.21.15.150:0/2243302173 learned_addr learned my addr 172.21.15.150:0/2243302173 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-08-17T02:25:40.538 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e5e00640 1 --2- 172.21.15.150:0/2243302173 >> v2:172.21.15.146:3300/0 conn(0x7f81e8159200 0x7f81e80aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e4a00640 1 -- 172.21.15.150:0/2243302173 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150197716 0 0) 0x7f81e80b0650 con 0x7f81e80d0490 2024-08-17T02:25:40.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e4a00640 1 -- 172.21.15.150:0/2243302173 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81cc0034e0 con 0x7f81e80d0490 2024-08-17T02:25:40.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e5e00640 1 -- 172.21.15.150:0/2243302173 >> v1:172.21.15.150:6789/0 conn(0x7f81e80d0490 legacy=0x7f81e80ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.539 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e5e00640 1 -- 172.21.15.150:0/2243302173 >> v1:172.21.15.146:6789/0 conn(0x7f81e80ae0d0 legacy=0x7f81e80b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.538+0000 7f81e5e00640 1 -- 172.21.15.150:0/2243302173 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b0b80 con 0x7f81e8159200 2024-08-17T02:25:40.540 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.539+0000 7f81e5e00640 1 --2- 172.21.15.150:0/2243302173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e8159200 0x7f81e80aeeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009850 tx=0x7f81d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccb2fd54c39872f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.539+0000 7f81e4a00640 1 -- 172.21.15.150:0/2243302173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d802ae40 con 0x7f81e8159200 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.539+0000 7f81e4a00640 1 -- 172.21.15.150:0/2243302173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8032440 con 0x7f81e8159200 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.539+0000 7f81e4a00640 1 -- 172.21.15.150:0/2243302173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80327e0 con 0x7f81e8159200 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 -- 172.21.15.150:0/2243302173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e8159200 msgr2=0x7f81e80aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 --2- 172.21.15.150:0/2243302173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e8159200 0x7f81e80aeeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009850 tx=0x7f81d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 -- 172.21.15.150:0/2243302173 shutdown_connections 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 --2- 172.21.15.150:0/2243302173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e8159200 0x7f81e80aeeb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 -- 172.21.15.150:0/2243302173 >> 172.21.15.150:0/2243302173 conn(0x7f81e806eb90 msgr2=0x7f81e80cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 -- 172.21.15.150:0/2243302173 shutdown_connections 2024-08-17T02:25:40.541 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.540+0000 7f81ed200640 1 -- 172.21.15.150:0/2243302173 wait complete. 2024-08-17T02:25:40.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.541+0000 7f81ed200640 1 Processor -- start 2024-08-17T02:25:40.542 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 -- start start 2024-08-17T02:25:40.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.543 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 0x7f81e8168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 0x7f81e809cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809b4d0 con 0x7f81e80d0490 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809a900 con 0x7f81e8159200 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.542+0000 7f81ed200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809aba0 con 0x7f81e80ae0d0 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e6800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 0x7f81e809cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:60192/0 (socket says 172.21.15.150:60192) 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 -- 172.21.15.150:0/1501676321 learned_addr learned my addr 172.21.15.150:0/1501676321 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5400640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 0x7f81e8168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 -- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 msgr2=0x7f81e809cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 0x7f81e809cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 -- 172.21.15.150:0/1501676321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 msgr2=0x7f81e8168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.544 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 0x7f81e8168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 -- 172.21.15.150:0/1501676321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009390 con 0x7f81e80ae0d0 2024-08-17T02:25:40.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e6800640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 0x7f81e809cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.545 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5400640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 0x7f81e8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.543+0000 7f81e5e00640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009360 tx=0x7f81d8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8000d10 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8031e00 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d803d650 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e809ae80 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e81692c0 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f81d8039040 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.544+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f81d802ae40 con 0x7f81e80ae0d0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.545+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e8071050 con 0x7f81e80ae0d0 2024-08-17T02:25:40.547 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.547+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f81d8042070 con 0x7f81e80ae0d0 2024-08-17T02:25:40.622 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.621+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d68d8c4-565a-4b04-8d1b-7bb663bafa5e", "id": 7} v 0) v1 -- 0x7f81e8152ee0 con 0x7f81e80ae0d0 2024-08-17T02:25:40.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.629+0000 7f81dd600640 1 -- 172.21.15.150:0/1501676321 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d68d8c4-565a-4b04-8d1b-7bb663bafa5e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81d8037070 con 0x7f81e80ae0d0 2024-08-17T02:25:40.629 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 msgr2=0x7f81e81529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009360 tx=0x7f81d8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 shutdown_connections 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e80d0490 0x7f81e8168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81e8159200 0x7f81e809cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 --2- 172.21.15.150:0/1501676321 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81e80ae0d0 0x7f81e81529a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 >> 172.21.15.150:0/1501676321 conn(0x7f81e806eb90 msgr2=0x7f81e8155820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 shutdown_connections 2024-08-17T02:25:40.631 INFO:teuthology.orchestra.run.smithi150.stderr:2024-08-17T02:25:40.630+0000 7f81ed200640 1 -- 172.21.15.150:0/1501676321 wait complete. 2024-08-17T02:25:40.644 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:25:40.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:25:40.648 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:25:40.648 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:25:40.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:25:40.652 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:25:40.652 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:25:40.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:25:40.656 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:25:40.656 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:25:40.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:25:40.660 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:25:40.660 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:25:40.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:25:40.688 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:25:40.688 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:25:40.688 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:25:40.692 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:25:40.692 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:25:40.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:25:40.697 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:25:40.697 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:25:40.697 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:25:40.702 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:25:40.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:40.719 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:40.718+0000 7fd22281bec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:40.806 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:40.805+0000 7fd22281bec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.887+0000 7f17da000640 1 Processor -- start 2024-08-17T02:25:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.887+0000 7f17da000640 1 -- start start 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17da000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f17d40ceb40 0x7f17d40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17da000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17d40ccad0 0x7f17d4162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17da000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d40ccf30 con 0x7f17d4159ca0 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17da000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40cd6e0 con 0x7f17d40ccad0 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17da000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40cadc0 con 0x7f17d40ceb40 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17d9600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17d40ccad0 0x7f17d4162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17d9600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17d40ccad0 0x7f17d4162860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47376/0 (socket says 172.21.15.146:47376) 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17d9600640 1 -- 172.21.15.146:0/3095847422 learned_addr learned my addr 172.21.15.146:0/3095847422 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.888+0000 7f17d3e00640 1 --2- 172.21.15.146:0/3095847422 >> v2:172.21.15.150:3300/0 conn(0x7f17d40ceb40 0x7f17d40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.889+0000 7f17d9600640 1 -- 172.21.15.146:0/3095847422 >> v2:172.21.15.150:3300/0 conn(0x7f17d40ceb40 msgr2=0x7f17d40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.889+0000 7f17d9600640 1 --2- 172.21.15.146:0/3095847422 >> v2:172.21.15.150:3300/0 conn(0x7f17d40ceb40 0x7f17d40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.889+0000 7f17d9600640 1 -- 172.21.15.146:0/3095847422 >> v1:172.21.15.150:6789/0 conn(0x7f17d4159ca0 legacy=0x7f17d40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.889+0000 7f17d9600640 1 -- 172.21.15.146:0/3095847422 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40cb060 con 0x7f17d40ccad0 2024-08-17T02:25:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17d9600640 1 --2- 172.21.15.146:0/3095847422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ccad0 0x7f17d4162860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17d408a060 tx=0x7f17cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f28f228f5c369a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17d3400640 1 -- 172.21.15.146:0/3095847422 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc02e050 con 0x7f17d40ccad0 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17d3400640 1 -- 172.21.15.146:0/3095847422 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc007400 con 0x7f17d40ccad0 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17d3400640 1 -- 172.21.15.146:0/3095847422 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0077e0 con 0x7f17d40ccad0 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17da000640 1 -- 172.21.15.146:0/3095847422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ccad0 msgr2=0x7f17d4162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.890+0000 7f17da000640 1 --2- 172.21.15.146:0/3095847422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ccad0 0x7f17d4162860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17d408a060 tx=0x7f17cc009840 comp rx=0 tx=0).stop 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 -- 172.21.15.146:0/3095847422 shutdown_connections 2024-08-17T02:25:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 --2- 172.21.15.146:0/3095847422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ccad0 0x7f17d4162860 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 --2- 172.21.15.146:0/3095847422 >> v2:172.21.15.150:3300/0 conn(0x7f17d40ceb40 0x7f17d40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 -- 172.21.15.146:0/3095847422 >> 172.21.15.146:0/3095847422 conn(0x7f17d4098e00 msgr2=0x7f17d406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 -- 172.21.15.146:0/3095847422 shutdown_connections 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.891+0000 7f17da000640 1 -- 172.21.15.146:0/3095847422 wait complete. 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.892+0000 7f17da000640 1 Processor -- start 2024-08-17T02:25:40.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.892+0000 7f17da000640 1 -- start start 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17d40ccad0 0x7f17d416bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 0x7f17d4169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d4155990 con 0x7f17d40ceb40 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c6bc0 con 0x7f17d4159ca0 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17da000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40c7740 con 0x7f17d40ccad0 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47380/0 (socket says 172.21.15.146:47380) 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17d3e00640 1 -- 172.21.15.146:0/977780356 learned_addr learned my addr 172.21.15.146:0/977780356 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17d9600640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 0x7f17d4169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.893+0000 7f17d8c00640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17d40ccad0 0x7f17d416bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 -- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17d40ccad0 msgr2=0x7f17d416bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17d40ccad0 0x7f17d416bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 -- 172.21.15.146:0/977780356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 msgr2=0x7f17d40c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 -- 172.21.15.146:0/977780356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc009ae0 con 0x7f17d4159ca0 2024-08-17T02:25:40.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d3e00640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.894+0000 7f17d9600640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 0x7f17d4169f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031000 tx=0x7f17cc037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc033e60 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc045410 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0457b0 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d40c5b40 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40c6e10 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f17cc039050 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.895+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f17cc03cbe0 con 0x7f17d4159ca0 2024-08-17T02:25:40.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.896+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d406eb90 con 0x7f17d4159ca0 2024-08-17T02:25:40.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.898+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f17d406eb90 con 0x7f17d4159ca0 2024-08-17T02:25:40.933 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:40.932+0000 7fd22281bec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:25:40.939 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:40.939+0000 7fd570615ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:25:40.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.960+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17d4071050 con 0x7f17d4159ca0 2024-08-17T02:25:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.961+0000 7f17c7e00640 1 -- 172.21.15.146:0/977780356 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f17cc040030 con 0x7f17d4159ca0 2024-08-17T02:25:40.962 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:40.962 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":10,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:40.623341+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 msgr2=0x7f17d4169f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 0x7f17d4169f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17cc031000 tx=0x7f17cc037000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 shutdown_connections 2024-08-17T02:25:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17d40ceb40 0x7f17d40c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17d4159ca0 0x7f17d4169f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 --2- 172.21.15.146:0/977780356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17d40ccad0 0x7f17d416bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 >> 172.21.15.146:0/977780356 conn(0x7f17d4098e00 msgr2=0x7f17d4156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 shutdown_connections 2024-08-17T02:25:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:40.962+0000 7f17da000640 1 -- 172.21.15.146:0/977780356 wait complete. 2024-08-17T02:25:40.978 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:25:40.978 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:25:41.208 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.207+0000 7fd570615ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:25:41.222 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.221+0000 7fd22281bec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:41.266 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.266+0000 7fd570615ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:25:41.274 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.274+0000 7fd22281bec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:41.335 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-08-17T02:25:41.334+0000 7fa57d3282c0 -1 Falling back to public interface 2024-08-17T02:25:41.345 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-08-17T02:25:41.344+0000 7f7e06c4f2c0 -1 Falling back to public interface 2024-08-17T02:25:41.349 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-08-17T02:25:41.348+0000 7fa4b27352c0 -1 Falling back to public interface 2024-08-17T02:25:41.356 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-08-17T02:25:41.356+0000 7f0e7ea0b2c0 -1 Falling back to public interface 2024-08-17T02:25:41.358 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-08-17T02:25:41.357+0000 7fde81a0a2c0 -1 Falling back to public interface 2024-08-17T02:25:41.359 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-08-17T02:25:41.359+0000 7f436cd232c0 -1 Falling back to public interface 2024-08-17T02:25:41.378 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.378+0000 7fd570615ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:25:41.381 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-08-17T02:25:41.381+0000 7f957b7882c0 -1 Falling back to public interface 2024-08-17T02:25:41.391 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-08-17T02:25:41.391+0000 7f373cc372c0 -1 Falling back to public interface 2024-08-17T02:25:41.455 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.454+0000 7fd22281bec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:41.511 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.510+0000 7fd22281bec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:41.589 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.588+0000 7fd22281bec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:41.642 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:41.641+0000 7fd22281bec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:41.673 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.673+0000 7fd570615ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:25:41.727 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.727+0000 7fd570615ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:25:41.783 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:41.907 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.906+0000 7fd570615ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:25:41.915 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.914+0000 7f9e56800640 1 Processor -- start 2024-08-17T02:25:41.915 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.914+0000 7f9e56800640 1 -- start start 2024-08-17T02:25:41.916 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e56800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e500cc320 0x7f9e500cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.916 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e56800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e500cd750 0x7f9e500cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e56800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500ce3b0 con 0x7f9e500c6c30 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e56800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500ce650 con 0x7f9e500cc320 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e56800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500ce910 con 0x7f9e500cd750 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.915+0000 7f9e55400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e500cc320 0x7f9e500cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e500cc320 0x7f9e500cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47390/0 (socket says 172.21.15.146:47390) 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 -- 172.21.15.146:0/3010452765 learned_addr learned my addr 172.21.15.146:0/3010452765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:41.917 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e54a00640 1 --2- 172.21.15.146:0/3010452765 >> v2:172.21.15.150:3300/0 conn(0x7f9e500cd750 0x7f9e500cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.918 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 -- 172.21.15.146:0/3010452765 >> v2:172.21.15.150:3300/0 conn(0x7f9e500cd750 msgr2=0x7f9e500cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:41.918 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 --2- 172.21.15.146:0/3010452765 >> v2:172.21.15.150:3300/0 conn(0x7f9e500cd750 0x7f9e500cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.918 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 -- 172.21.15.146:0/3010452765 >> v1:172.21.15.150:6789/0 conn(0x7f9e500c6c30 legacy=0x7f9e500c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.918 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.916+0000 7f9e55400640 1 -- 172.21.15.146:0/3010452765 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500cebf0 con 0x7f9e500cc320 2024-08-17T02:25:41.918 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.917+0000 7f9e55400640 1 --2- 172.21.15.146:0/3010452765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500cc320 0x7f9e500cf3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e500b5ce0 tx=0x7f9e440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592ff9d654b85d96 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.917+0000 7f9e4fe00640 1 -- 172.21.15.146:0/3010452765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4402ae80 con 0x7f9e500cc320 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.917+0000 7f9e4fe00640 1 -- 172.21.15.146:0/3010452765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44032440 con 0x7f9e500cc320 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.917+0000 7f9e4fe00640 1 -- 172.21.15.146:0/3010452765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44032800 con 0x7f9e500cc320 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 -- 172.21.15.146:0/3010452765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500cc320 msgr2=0x7f9e500cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 --2- 172.21.15.146:0/3010452765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500cc320 0x7f9e500cf3f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e500b5ce0 tx=0x7f9e440091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 -- 172.21.15.146:0/3010452765 shutdown_connections 2024-08-17T02:25:41.919 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 --2- 172.21.15.146:0/3010452765 >> v2:172.21.15.150:3300/0 conn(0x7f9e500cd750 0x7f9e500cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 --2- 172.21.15.146:0/3010452765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500cc320 0x7f9e500cf3f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 -- 172.21.15.146:0/3010452765 >> 172.21.15.146:0/3010452765 conn(0x7f9e50089140 msgr2=0x7f9e50089540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 -- 172.21.15.146:0/3010452765 shutdown_connections 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.918+0000 7f9e56800640 1 -- 172.21.15.146:0/3010452765 wait complete. 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.919+0000 7f9e56800640 1 Processor -- start 2024-08-17T02:25:41.920 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.919+0000 7f9e56800640 1 -- start start 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 0x7f9e501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e500cd750 0x7f9e500ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50158f70 con 0x7f9e500c6c30 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50159dd0 con 0x7f9e500cc320 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e56800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e501591c0 con 0x7f9e500cd750 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.920+0000 7f9e55400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.922 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47396/0 (socket says 172.21.15.146:47396) 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 -- 172.21.15.146:0/4165136890 learned_addr learned my addr 172.21.15.146:0/4165136890 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55e00640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e500cd750 0x7f9e500ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e54a00640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 0x7f9e501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 -- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e500cd750 msgr2=0x7f9e500ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e500cd750 0x7f9e500ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 -- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 msgr2=0x7f9e501550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 0x7f9e501550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 -- 172.21.15.146:0/4165136890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009450 con 0x7f9e500c6c30 2024-08-17T02:25:41.923 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e54a00640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 0x7f9e501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:41.924 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e55400640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e44032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.924 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.921+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44031c80 con 0x7f9e500c6c30 2024-08-17T02:25:41.924 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44031e00 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e501594a0 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4403d670 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50159830 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9e44039040 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.922+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f9e4403bad0 con 0x7f9e500c6c30 2024-08-17T02:25:41.925 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.923+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50159630 con 0x7f9e500c6c30 2024-08-17T02:25:41.926 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:41.926+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9e44042070 con 0x7f9e500c6c30 2024-08-17T02:25:41.966 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:41.966+0000 7fd570615ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:25:42.010 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.009+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e50071100 con 0x7f9e500c6c30 2024-08-17T02:25:42.011 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.010+0000 7f9e4cc00640 1 -- 172.21.15.146:0/4165136890 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e500c6c30 2024-08-17T02:25:42.011 INFO:teuthology.misc.health.smithi146.stdout: 2024-08-17T02:25:42.012 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:40.623341+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 msgr2=0x7f9e5016ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e44032000 comp rx=0 tx=0).stop 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 shutdown_connections 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e500cd750 0x7f9e500ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e500cc320 0x7f9e501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 --2- 172.21.15.146:0/4165136890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e500c6c30 0x7f9e5016ce60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 >> 172.21.15.146:0/4165136890 conn(0x7f9e50089140 msgr2=0x7f9e500cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 shutdown_connections 2024-08-17T02:25:42.013 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:42.011+0000 7f9e56800640 1 -- 172.21.15.146:0/4165136890 wait complete. 2024-08-17T02:25:42.025 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:25:42.044 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:42.043+0000 7fd570615ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:25:42.094 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:42.093+0000 7fd570615ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:25:42.197 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:42.195+0000 7fd22281bec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:42.305 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:42.304+0000 7fd22281bec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:42.624 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:42.624+0000 7fd570615ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:25:42.734 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-08-17T02:25:42.733+0000 7fd570615ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:25:43.325 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:43.324+0000 7fd207000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:25:43.325 INFO:tasks.ceph.mgr.y.smithi146.stderr:2024-08-17T02:25:43.324+0000 7fd207000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:25:44.875 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-08-17T02:25:44.874+0000 7fa57d3282c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:25:44.901 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-08-17T02:25:44.900+0000 7f0e7ea0b2c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:25:44.928 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-08-17T02:25:44.928+0000 7f436cd232c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:25:44.942 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-08-17T02:25:44.942+0000 7f957b7882c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:25:44.980 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-08-17T02:25:44.980+0000 7f373cc372c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:25:44.990 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-08-17T02:25:44.990+0000 7f7e06c4f2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:25:44.992 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-08-17T02:25:44.992+0000 7fde81a0a2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:25:45.001 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-08-17T02:25:45.001+0000 7fa4b27352c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:25:48.484 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-08-17T02:25:48.483+0000 7f9574e00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:25:48.494 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-08-17T02:25:48.492+0000 7f956c200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.531 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-08-17T02:25:48.531+0000 7f7e00a00640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:25:48.542 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-08-17T02:25:48.542+0000 7f7df7e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.548 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-08-17T02:25:48.548+0000 7fa4abe00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:25:48.555 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-08-17T02:25:48.555+0000 7fa4a3200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.606 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-08-17T02:25:48.606+0000 7f3736a00640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:25:48.609 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-08-17T02:25:48.609+0000 7fa576a00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:25:48.614 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-08-17T02:25:48.614+0000 7fa56de00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.614 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-08-17T02:25:48.614+0000 7f372de00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.623 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-08-17T02:25:48.623+0000 7f0e77e00640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:25:48.628 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-08-17T02:25:48.628+0000 7f0e6f200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.659 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-08-17T02:25:48.659+0000 7f4366400640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:25:48.665 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-08-17T02:25:48.665+0000 7f435d800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.673 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-08-17T02:25:48.673+0000 7fde7ae00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:25:48.678 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-08-17T02:25:48.678+0000 7fde72200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:48.832 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:48.961 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.961+0000 7fcd64200640 1 Processor -- start 2024-08-17T02:25:48.961 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.961+0000 7fcd64200640 1 -- start start 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.962+0000 7fcd64200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c140520 0x7fcd5c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.962+0000 7fcd64200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcd5c0c8b10 0x7fcd5c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.962+0000 7fcd64200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0ae640 con 0x7fcd5c0ae010 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.962+0000 7fcd64200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0af4b0 con 0x7fcd5c140520 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.962+0000 7fcd64200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0cb6c0 con 0x7fcd5c0c8b10 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c140520 0x7fcd5c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.963 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c140520 0x7fcd5c0adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45566/0 (socket says 172.21.15.146:45566) 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 -- 172.21.15.146:0/2543952994 learned_addr learned my addr 172.21.15.146:0/2543952994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd60e00640 1 --1- 172.21.15.146:0/2543952994 >> v1:172.21.15.146:6789/0 conn(0x7fcd5c0ae010 0x7fcd5c0c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52022/0 (socket says 172.21.15.146:52022) 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd62200640 1 --2- 172.21.15.146:0/2543952994 >> v2:172.21.15.150:3300/0 conn(0x7fcd5c0c8b10 0x7fcd5c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 -- 172.21.15.146:0/2543952994 >> v2:172.21.15.150:3300/0 conn(0x7fcd5c0c8b10 msgr2=0x7fcd5c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 --2- 172.21.15.146:0/2543952994 >> v2:172.21.15.150:3300/0 conn(0x7fcd5c0c8b10 0x7fcd5c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 -- 172.21.15.146:0/2543952994 >> v1:172.21.15.146:6789/0 conn(0x7fcd5c0ae010 legacy=0x7fcd5c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd61800640 1 -- 172.21.15.146:0/2543952994 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c0aeb80 con 0x7fcd5c140520 2024-08-17T02:25:48.964 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.963+0000 7fcd5be00640 1 -- 172.21.15.146:0/2543952994 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173201589 0 0) 0x7fcd5c0ae640 con 0x7fcd5c0ae010 2024-08-17T02:25:48.965 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.964+0000 7fcd61800640 1 --2- 172.21.15.146:0/2543952994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0adad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0602d0 tx=0x7fcd500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1502ffb89bb9ac09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.965 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.964+0000 7fcd5be00640 1 -- 172.21.15.146:0/2543952994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5002ae80 con 0x7fcd5c140520 2024-08-17T02:25:48.965 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.964+0000 7fcd5be00640 1 -- 172.21.15.146:0/2543952994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50032440 con 0x7fcd5c140520 2024-08-17T02:25:48.965 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.964+0000 7fcd5be00640 1 -- 172.21.15.146:0/2543952994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500327c0 con 0x7fcd5c140520 2024-08-17T02:25:48.965 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 -- 172.21.15.146:0/2543952994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 msgr2=0x7fcd5c0adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 --2- 172.21.15.146:0/2543952994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0adad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0602d0 tx=0x7fcd500091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 -- 172.21.15.146:0/2543952994 shutdown_connections 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 --2- 172.21.15.146:0/2543952994 >> v2:172.21.15.150:3300/0 conn(0x7fcd5c0c8b10 0x7fcd5c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 --2- 172.21.15.146:0/2543952994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0adad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 -- 172.21.15.146:0/2543952994 >> 172.21.15.146:0/2543952994 conn(0x7fcd5c067810 msgr2=0x7fcd5c06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 -- 172.21.15.146:0/2543952994 shutdown_connections 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.965+0000 7fcd64200640 1 -- 172.21.15.146:0/2543952994 wait complete. 2024-08-17T02:25:48.966 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.966+0000 7fcd64200640 1 Processor -- start 2024-08-17T02:25:48.967 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.966+0000 7fcd64200640 1 -- start start 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 0x7fcd5c16ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd5c0c8b10 0x7fcd5c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c159ee0 con 0x7fcd5c140520 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c16bf90 con 0x7fcd5c0ae010 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.967+0000 7fcd64200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c15b270 con 0x7fcd5c0c8b10 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45582/0 (socket says 172.21.15.146:45582) 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 -- 172.21.15.146:0/3711470533 learned_addr learned my addr 172.21.15.146:0/3711470533 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd60e00640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd5c0c8b10 0x7fcd5c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.969 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd61800640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 0x7fcd5c16ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 -- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd5c0c8b10 msgr2=0x7fcd5c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd5c0c8b10 0x7fcd5c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 -- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 msgr2=0x7fcd5c16ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 0x7fcd5c16ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 -- 172.21.15.146:0/3711470533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009450 con 0x7fcd5c140520 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd61800640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 0x7fcd5c16ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.968+0000 7fcd62200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009ef0 tx=0x7fcd5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.969+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400ce10 con 0x7fcd5c140520 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.969+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5400f040 con 0x7fcd5c140520 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.969+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540146d0 con 0x7fcd5c140520 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.969+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c15b550 con 0x7fcd5c140520 2024-08-17T02:25:48.970 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.969+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c15bb10 con 0x7fcd5c140520 2024-08-17T02:25:48.971 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.970+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c064a50 con 0x7fcd5c140520 2024-08-17T02:25:48.971 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.970+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fcd54014a80 con 0x7fcd5c140520 2024-08-17T02:25:48.971 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.971+0000 7fcd58c00640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 0x7fcd3c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.972 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.971+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fcd540824c0 con 0x7fcd5c140520 2024-08-17T02:25:48.972 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.971+0000 7fcd61800640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 0x7fcd3c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.972 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.972+0000 7fcd61800640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 0x7fcd3c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd50034000 tx=0x7fcd50032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.977 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:48.976+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcd54051350 con 0x7fcd5c140520 2024-08-17T02:25:49.154 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.154+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd5c0b0370 con 0x7fcd5c140520 2024-08-17T02:25:49.155 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.155+0000 7fcd58c00640 1 -- 172.21.15.146:0/3711470533 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fcd54018090 con 0x7fcd5c140520 2024-08-17T02:25:49.155 INFO:teuthology.misc.health.smithi146.stdout: 2024-08-17T02:25:49.155 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":12,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:46.332625+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:49.157 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 msgr2=0x7fcd3c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 0x7fcd3c067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd50034000 tx=0x7fcd50032000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 msgr2=0x7fcd5c0ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009ef0 tx=0x7fcd5400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 shutdown_connections 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcd3c0650c0 0x7fcd3c067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c140520 0x7fcd5c0ab2c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcd5c0c8b10 0x7fcd5c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 --2- 172.21.15.146:0/3711470533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd5c0ae010 0x7fcd5c16ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 >> 172.21.15.146:0/3711470533 conn(0x7fcd5c067810 msgr2=0x7fcd5c069370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 shutdown_connections 2024-08-17T02:25:49.158 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:49.157+0000 7fcd64200640 1 -- 172.21.15.146:0/3711470533 wait complete. 2024-08-17T02:25:49.169 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:25:55.975 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:56.115 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.115+0000 7f48b8600640 1 Processor -- start 2024-08-17T02:25:56.115 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.115+0000 7f48b8600640 1 -- start start 2024-08-17T02:25:56.116 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.116+0000 7f48b8600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48b00c8400 0x7f48b00c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.116 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.116+0000 7f48b8600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00c8da0 con 0x7f48b00af940 2024-08-17T02:25:56.117 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.116+0000 7f48b8600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00ae640 con 0x7f48b0140520 2024-08-17T02:25:56.117 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.116+0000 7f48b8600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00af4b0 con 0x7f48b00c8400 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48b00c8400 0x7f48b00c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b6600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48b00af940 0x7f48b00afd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54600/0 (socket says 172.21.15.146:54600) 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b6600640 1 -- 172.21.15.146:0/4207048093 learned_addr learned my addr 172.21.15.146:0/4207048093 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b5200640 1 -- 172.21.15.146:0/4207048093 >> v1:172.21.15.150:6789/0 conn(0x7f48b0140520 legacy=0x7f48b00adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b5200640 1 -- 172.21.15.146:0/4207048093 >> v1:172.21.15.146:6789/0 conn(0x7f48b00af940 legacy=0x7f48b00afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48afe00640 1 -- 172.21.15.146:0/4207048093 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515977708 0 0) 0x7f48a8001490 con 0x7f48b00af940 2024-08-17T02:25:56.118 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.117+0000 7f48b5200640 1 -- 172.21.15.146:0/4207048093 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00cb6c0 con 0x7f48b00c8400 2024-08-17T02:25:56.119 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.118+0000 7f48b5200640 1 --2- 172.21.15.146:0/4207048093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b00c8400 0x7f48b00c8860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f489c009850 tx=0x7f489c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e47384db43d64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.119 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48afe00640 1 -- 172.21.15.146:0/4207048093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c02adb0 con 0x7f48b00c8400 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48afe00640 1 -- 172.21.15.146:0/4207048093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c032440 con 0x7f48b00c8400 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48afe00640 1 -- 172.21.15.146:0/4207048093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0327e0 con 0x7f48b00c8400 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 -- 172.21.15.146:0/4207048093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b00c8400 msgr2=0x7f48b00c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 --2- 172.21.15.146:0/4207048093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b00c8400 0x7f48b00c8860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f489c009850 tx=0x7f489c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 -- 172.21.15.146:0/4207048093 shutdown_connections 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 --2- 172.21.15.146:0/4207048093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b00c8400 0x7f48b00c8860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 -- 172.21.15.146:0/4207048093 >> 172.21.15.146:0/4207048093 conn(0x7f48b0067810 msgr2=0x7f48b006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 -- 172.21.15.146:0/4207048093 shutdown_connections 2024-08-17T02:25:56.120 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.119+0000 7f48b8600640 1 -- 172.21.15.146:0/4207048093 wait complete. 2024-08-17T02:25:56.121 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.121+0000 7f48b8600640 1 Processor -- start 2024-08-17T02:25:56.121 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.121+0000 7f48b8600640 1 -- start start 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00af940 0x7f48b0158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 0x7f48b006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0159410 con 0x7f48b0140520 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0169460 con 0x7f48b00c8400 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b8600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0169740 con 0x7f48b00af940 2024-08-17T02:25:56.123 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57146/0 (socket says 172.21.15.146:57146) 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 -- 172.21.15.146:0/659932825 learned_addr learned my addr 172.21.15.146:0/659932825 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b5200640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 0x7f48b006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b5c00640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00af940 0x7f48b0158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 -- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00af940 msgr2=0x7f48b0158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00af940 0x7f48b0158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 -- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 msgr2=0x7f48b006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 0x7f48b006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b6600640 1 -- 172.21.15.146:0/659932825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c009390 con 0x7f48b0140520 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.122+0000 7f48b5200640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 0x7f48b006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48b6600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48a800cc10 tx=0x7f48a8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800ce30 con 0x7f48b0140520 2024-08-17T02:25:56.124 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800a7f0 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800abf0 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b0169a20 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.123+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b0169fe0 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.124+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b0064a50 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.125+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f48a800ad50 con 0x7f48b0140520 2024-08-17T02:25:56.125 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.126+0000 7f48acc00640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 0x7f4890067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.126 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.126+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f48a8082160 con 0x7f48b0140520 2024-08-17T02:25:56.126 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.126+0000 7f48b5c00640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 0x7f4890067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.126 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.127+0000 7f48b5c00640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 0x7f4890067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48a40037d0 tx=0x7f48a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.130 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.131+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48a80504c0 con 0x7f48b0140520 2024-08-17T02:25:56.306 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.306+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48b00c8da0 con 0x7f48b0140520 2024-08-17T02:25:56.307 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.307+0000 7f48acc00640 1 -- 172.21.15.146:0/659932825 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f48b00c8da0 con 0x7f48b0140520 2024-08-17T02:25:56.307 INFO:teuthology.misc.health.smithi146.stdout: 2024-08-17T02:25:56.307 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":16,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:52.513854+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:56.309 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 msgr2=0x7f4890067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.309 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 0x7f4890067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48a40037d0 tx=0x7f48a4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:56.309 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 msgr2=0x7f48b006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.309 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48a800cc10 tx=0x7f48a8001970 comp rx=0 tx=0).stop 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 shutdown_connections 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4890065150 0x7f4890067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b0140520 0x7f48b006d640 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f48b00c8400 0x7f48b006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 --2- 172.21.15.146:0/659932825 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f48b00af940 0x7f48b0158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 >> 172.21.15.146:0/659932825 conn(0x7f48b0067810 msgr2=0x7f48b013c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 shutdown_connections 2024-08-17T02:25:56.310 INFO:teuthology.misc.health.smithi146.stderr:2024-08-17T02:25:56.309+0000 7f48b8600640 1 -- 172.21.15.146:0/659932825 wait complete. 2024-08-17T02:25:56.321 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:25:56.322 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:25:56.322 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:56.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:56.327 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:56.327 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:56.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:56.331 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:56.333 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:56.333 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:56.338 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:56.338 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:56.338 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:56.342 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:56.342 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:25:56.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:56.451 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-08-17T02:25:56.453 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-08-17T02:25:56.471 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-08-17T02:25:56.471 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-08-17T02:25:56.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.500+0000 7fead6200640 1 Processor -- start 2024-08-17T02:25:56.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.500+0000 7fead6200640 1 -- start start 2024-08-17T02:25:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fead00cc430 0x7fead00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead0062da0 0x7fead0067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fead0159820 0x7fead00cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00ca700 con 0x7fead0159820 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00684f0 con 0x7fead00cc430 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.501+0000 7fead6200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00c9dd0 con 0x7fead0062da0 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fead0159820 0x7fead00cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fead0159820 0x7fead00cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57166/0 (socket says 172.21.15.146:57166) 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 -- 172.21.15.146:0/2118728400 learned_addr learned my addr 172.21.15.146:0/2118728400 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feac7e00640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead0062da0 0x7fead0067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacf400640 1 --2- 172.21.15.146:0/2118728400 >> v2:172.21.15.150:3300/0 conn(0x7fead00cc430 0x7fead00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 -- 172.21.15.146:0/2118728400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead0062da0 msgr2=0x7fead0067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead0062da0 0x7fead0067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 -- 172.21.15.146:0/2118728400 >> v2:172.21.15.150:3300/0 conn(0x7fead00cc430 msgr2=0x7fead00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 --2- 172.21.15.146:0/2118728400 >> v2:172.21.15.150:3300/0 conn(0x7fead00cc430 0x7fead00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.502+0000 7feacfe00640 1 -- 172.21.15.146:0/2118728400 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00ca0b0 con 0x7fead0159820 2024-08-17T02:25:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.503+0000 7feacfe00640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0159820 0x7fead00cab90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fead0070890 tx=0x7feac8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69992fc169b986ff server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.503+0000 7feacea00640 1 -- 172.21.15.146:0/2118728400 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8031400 con 0x7fead0159820 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.503+0000 7feacea00640 1 -- 172.21.15.146:0/2118728400 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac802d050 con 0x7fead0159820 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.503+0000 7feacea00640 1 -- 172.21.15.146:0/2118728400 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80317d0 con 0x7fead0159820 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 -- 172.21.15.146:0/2118728400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0159820 msgr2=0x7fead00cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0159820 0x7fead00cab90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fead0070890 tx=0x7feac8009840 comp rx=0 tx=0).stop 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 -- 172.21.15.146:0/2118728400 shutdown_connections 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0159820 0x7fead00cab90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 --2- 172.21.15.146:0/2118728400 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead0062da0 0x7fead0067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 --2- 172.21.15.146:0/2118728400 >> v2:172.21.15.150:3300/0 conn(0x7fead00cc430 0x7fead00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 -- 172.21.15.146:0/2118728400 >> 172.21.15.146:0/2118728400 conn(0x7fead00afc30 msgr2=0x7fead00b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 -- 172.21.15.146:0/2118728400 shutdown_connections 2024-08-17T02:25:56.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.504+0000 7fead6200640 1 -- 172.21.15.146:0/2118728400 wait complete. 2024-08-17T02:25:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.505+0000 7fead6200640 1 Processor -- start 2024-08-17T02:25:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.505+0000 7fead6200640 1 -- start start 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 0x7fead0153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead00cc430 0x7fead0152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 0x7fead00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0168da0 con 0x7fead0062da0 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0169080 con 0x7fead0159820 2024-08-17T02:25:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7fead6200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0169360 con 0x7fead00cc430 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7feacf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 0x7fead0153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.506+0000 7feacf400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 0x7fead0153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57178/0 (socket says 172.21.15.146:57178) 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 0x7fead00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feac7e00640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead00cc430 0x7fead0152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacf400640 1 -- 172.21.15.146:0/4072495986 learned_addr learned my addr 172.21.15.146:0/4072495986 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 -- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead00cc430 msgr2=0x7fead0152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead00cc430 0x7fead0152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 -- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 msgr2=0x7fead0153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 0x7fead0153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 -- 172.21.15.146:0/4072495986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8009ae0 con 0x7fead0159820 2024-08-17T02:25:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.507+0000 7feacfe00640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 0x7fead00c87a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feac8030000 tx=0x7feac8036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.508+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8008e50 con 0x7fead0159820 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.508+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac803b410 con 0x7fead0159820 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.508+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac803b7b0 con 0x7fead0159820 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.508+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead0169640 con 0x7fead0159820 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.508+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0153ec0 con 0x7fead0159820 2024-08-17T02:25:56.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.509+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead01694a0 con 0x7fead0159820 2024-08-17T02:25:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.510+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feac8038050 con 0x7fead0159820 2024-08-17T02:25:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.510+0000 7feac6a00640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 0x7feaac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.510+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feac80a2e80 con 0x7fead0159820 2024-08-17T02:25:56.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.511+0000 7feacf400640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 0x7feaac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.511+0000 7feacf400640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 0x7feaac067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feac0007c60 tx=0x7feac0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.516+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fead01694a0 con 0x7fead0159820 2024-08-17T02:25:56.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.692+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fead01694a0 con 0x7fead0159820 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.693+0000 7feac6a00640 1 -- 172.21.15.146:0/4072495986 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fead01694a0 con 0x7fead0159820 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:52.513854+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:56.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 msgr2=0x7feaac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 0x7feaac067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feac0007c60 tx=0x7feac0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:56.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 msgr2=0x7fead00c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 0x7fead00c87a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feac8030000 tx=0x7feac8036000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 shutdown_connections 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7feaac065150 0x7feaac067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fead0159820 0x7fead00c87a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fead00cc430 0x7fead0152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 --2- 172.21.15.146:0/4072495986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fead0062da0 0x7fead0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 >> 172.21.15.146:0/4072495986 conn(0x7fead00afc30 msgr2=0x7fead0158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 shutdown_connections 2024-08-17T02:25:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.695+0000 7fead6200640 1 -- 172.21.15.146:0/4072495986 wait complete. 2024-08-17T02:25:56.710 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:56.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:56.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.861+0000 7f951e600640 1 Processor -- start 2024-08-17T02:25:56.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.861+0000 7f951e600640 1 -- start start 2024-08-17T02:25:56.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.862+0000 7f951e600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95180accf0 0x7f95180b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.862+0000 7f951e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 0x7f9518157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.862+0000 7f951e600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95180ae540 con 0x7f9518159610 2024-08-17T02:25:56.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.862+0000 7f951e600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180ad930 con 0x7f95180accf0 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.862+0000 7f951e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180adc10 con 0x7f95180afd90 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95180accf0 0x7f95180b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 0x7f9518157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95180accf0 0x7f95180b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50660/0 (socket says 172.21.15.146:50660) 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 -- 172.21.15.146:0/3196882932 learned_addr learned my addr 172.21.15.146:0/3196882932 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9516a00640 1 --1- 172.21.15.146:0/3196882932 >> v1:172.21.15.150:6789/0 conn(0x7f9518159610 0x7f95180af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:41160/0 (socket says 172.21.15.146:41160) 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 -- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 msgr2=0x7f9518157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 0x7f9518157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 -- 172.21.15.146:0/3196882932 >> v1:172.21.15.150:6789/0 conn(0x7f9518159610 legacy=0x7f95180af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517400640 1 -- 172.21.15.146:0/3196882932 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180adef0 con 0x7f95180accf0 2024-08-17T02:25:56.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9516000640 1 -- 172.21.15.146:0/3196882932 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034445661 0 0) 0x7f95180ae540 con 0x7f9518159610 2024-08-17T02:25:56.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.863+0000 7f9517e00640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 0x7f9518157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.864+0000 7f9517400640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f95180b1670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f950800bbc0 tx=0x7f950800b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d2e0a4cdec776e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.864+0000 7f9516000640 1 -- 172.21.15.146:0/3196882932 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508031610 con 0x7f95180accf0 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.864+0000 7f9516000640 1 -- 172.21.15.146:0/3196882932 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508031770 con 0x7f95180accf0 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.864+0000 7f9516000640 1 -- 172.21.15.146:0/3196882932 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508031b10 con 0x7f95180accf0 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 -- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 msgr2=0x7f95180b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f95180b1670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f950800bbc0 tx=0x7f950800b460 comp rx=0 tx=0).stop 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 -- 172.21.15.146:0/3196882932 shutdown_connections 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95180afd90 0x7f9518157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 --2- 172.21.15.146:0/3196882932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f95180b1670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 -- 172.21.15.146:0/3196882932 >> 172.21.15.146:0/3196882932 conn(0x7f9518067750 msgr2=0x7f95180cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 -- 172.21.15.146:0/3196882932 shutdown_connections 2024-08-17T02:25:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.865+0000 7f951e600640 1 -- 172.21.15.146:0/3196882932 wait complete. 2024-08-17T02:25:56.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.866+0000 7f951e600640 1 Processor -- start 2024-08-17T02:25:56.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 -- start start 2024-08-17T02:25:56.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9518159610 0x7f9518146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180aa960 con 0x7f95180afd90 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180a9d50 con 0x7f95180accf0 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.867+0000 7f951e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180aa030 con 0x7f9518159610 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9517400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57184/0 (socket says 172.21.15.146:57184) 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 -- 172.21.15.146:0/3407726987 learned_addr learned my addr 172.21.15.146:0/3407726987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9517400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50664/0 (socket says 172.21.15.146:50664) 2024-08-17T02:25:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9517e00640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9518159610 0x7f9518146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 -- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9518159610 msgr2=0x7f9518146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9518159610 0x7f9518146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 -- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 msgr2=0x7f9518157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 -- 172.21.15.146:0/3407726987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009a20 con 0x7f95180afd90 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9517400640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.868+0000 7f9516a00640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f950400c5b0 tx=0x7f9504007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.869+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040072e0 con 0x7f95180afd90 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.869+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504007460 con 0x7f95180afd90 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.869+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040047a0 con 0x7f95180afd90 2024-08-17T02:25:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.869+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950800b700 con 0x7f95180afd90 2024-08-17T02:25:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.869+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95180aa5f0 con 0x7f95180afd90 2024-08-17T02:25:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.870+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95180aaad0 con 0x7f95180afd90 2024-08-17T02:25:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.871+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9504004bf0 con 0x7f95180afd90 2024-08-17T02:25:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.871+0000 7f950ea00640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 0x7f94f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.872+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f95040819e0 con 0x7f95180afd90 2024-08-17T02:25:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.872+0000 7f9517400640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 0x7f94f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.872+0000 7f9517400640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 0x7f94f8067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9508037000 tx=0x7f950803a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:56.876+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f950404fd50 con 0x7f95180afd90 2024-08-17T02:25:57.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.051+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9518064db0 con 0x7f95180afd90 2024-08-17T02:25:57.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.052+0000 7f950ea00640 1 -- 172.21.15.146:0/3407726987 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9504053370 con 0x7f95180afd90 2024-08-17T02:25:57.052 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:25:57.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 msgr2=0x7f94f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 0x7f94f8067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9508037000 tx=0x7f950803a000 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 msgr2=0x7f9518146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f950400c5b0 tx=0x7f9504007f20 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 shutdown_connections 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f94f8065150 0x7f94f8067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95180afd90 0x7f9518146020 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9518159610 0x7f9518146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 --2- 172.21.15.146:0/3407726987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95180accf0 0x7f9518157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 >> 172.21.15.146:0/3407726987 conn(0x7f9518067750 msgr2=0x7f95181546f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 shutdown_connections 2024-08-17T02:25:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.054+0000 7f951e600640 1 -- 172.21.15.146:0/3407726987 wait complete. 2024-08-17T02:25:57.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:57.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.217+0000 7f4fac000640 1 Processor -- start 2024-08-17T02:25:57.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.217+0000 7f4fac000640 1 -- start start 2024-08-17T02:25:57.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fac000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fac000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa4158fa0 0x7f4fa40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fac000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa40a9a10 con 0x7f4fa406da20 2024-08-17T02:25:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fac000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40ac400 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fac000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40a9cf0 con 0x7f4fa4158fa0 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4faa000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa4158fa0 0x7f4fa40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50672/0 (socket says 172.21.15.146:50672) 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 -- 172.21.15.146:0/1610110545 learned_addr learned my addr 172.21.15.146:0/1610110545 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 -- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa4158fa0 msgr2=0x7f4fa40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 --2- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa4158fa0 0x7f4fa40ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 -- 172.21.15.146:0/1610110545 >> v1:172.21.15.150:6789/0 conn(0x7f4fa406da20 legacy=0x7f4fa4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.219+0000 7f4fa8c00640 1 -- 172.21.15.146:0/1610110545 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40a9fd0 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.220+0000 7f4fa8c00640 1 --2- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009910 tx=0x7f4f900091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ef56b904937c85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fa3e00640 1 -- 172.21.15.146:0/1610110545 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9002adb0 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fa3e00640 1 -- 172.21.15.146:0/1610110545 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90032440 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fa3e00640 1 -- 172.21.15.146:0/1610110545 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90032820 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 -- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40aa7d0 msgr2=0x7f4fa406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 --2- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009910 tx=0x7f4f900091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 -- 172.21.15.146:0/1610110545 shutdown_connections 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 --2- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa4158fa0 0x7f4fa40ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 --2- 172.21.15.146:0/1610110545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa40aa7d0 0x7f4fa406ddf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 -- 172.21.15.146:0/1610110545 >> 172.21.15.146:0/1610110545 conn(0x7f4fa40cb9b0 msgr2=0x7f4fa40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 -- 172.21.15.146:0/1610110545 shutdown_connections 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.221+0000 7f4fac000640 1 -- 172.21.15.146:0/1610110545 wait complete. 2024-08-17T02:25:57.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.223+0000 7f4fac000640 1 Processor -- start 2024-08-17T02:25:57.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.223+0000 7f4fac000640 1 -- start start 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa40aa7d0 0x7f4fa40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 0x7f4fa40696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa414a950 con 0x7f4fa406da20 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40c82d0 con 0x7f4fa4158fa0 2024-08-17T02:25:57.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fac000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4157830 con 0x7f4fa40aa7d0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fa9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fa9600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57192/0 (socket says 172.21.15.146:57192) 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fa9600640 1 -- 172.21.15.146:0/3416031485 learned_addr learned my addr 172.21.15.146:0/3416031485 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 0x7f4fa40696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fa8c00640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa40aa7d0 0x7f4fa40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 -- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa40aa7d0 msgr2=0x7f4fa40c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa40aa7d0 0x7f4fa40c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 -- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 msgr2=0x7f4fa4157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4faa000640 1 -- 172.21.15.146:0/3416031485 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009450 con 0x7f4fa4158fa0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.224+0000 7f4fa9600640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4faa000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 0x7f4fa40696a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00ecc0 tx=0x7f4f9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00cb30 con 0x7f4fa4158fa0 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00f040 con 0x7f4fa4158fa0 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c014480 con 0x7f4fa4158fa0 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa4157b10 con 0x7f4fa4158fa0 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.225+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa41580d0 con 0x7f4fa4158fa0 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.226+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa40c8440 con 0x7f4fa4158fa0 2024-08-17T02:25:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.227+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f9c014a80 con 0x7f4fa4158fa0 2024-08-17T02:25:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.227+0000 7f4fa0c00640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 0x7f4f84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.228+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f9c082ec0 con 0x7f4fa4158fa0 2024-08-17T02:25:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.228+0000 7f4fa9600640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 0x7f4f84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.228+0000 7f4fa9600640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 0x7f4f84067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40cb2d0 tx=0x7f4f98009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.232+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4fa40c8440 con 0x7f4fa4158fa0 2024-08-17T02:25:57.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.447+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fa40c8410 con 0x7f4fa4158fa0 2024-08-17T02:25:57.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.448+0000 7f4fa0c00640 1 -- 172.21.15.146:0/3416031485 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f4f9c018090 con 0x7f4fa4158fa0 2024-08-17T02:25:57.449 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:57.449 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:25:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 2 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 msgr2=0x7f4f84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 0x7f4f84067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40cb2d0 tx=0x7f4f98009040 comp rx=0 tx=0).stop 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 msgr2=0x7f4fa40696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 0x7f4fa40696a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00ecc0 tx=0x7f4f9c00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 shutdown_connections 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4f84065150 0x7f4f84067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4fa4158fa0 0x7f4fa40696a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4fa40aa7d0 0x7f4fa40c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 --2- 172.21.15.146:0/3416031485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa406da20 0x7f4fa4157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.450+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 >> 172.21.15.146:0/3416031485 conn(0x7f4fa40cb9b0 msgr2=0x7f4fa40afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.451+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 shutdown_connections 2024-08-17T02:25:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:57.451+0000 7f4fac000640 1 -- 172.21.15.146:0/3416031485 wait complete. 2024-08-17T02:25:59.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:59.028 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:59.467 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.626+0000 7f57a8800640 1 Processor -- start 2024-08-17T02:25:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.626+0000 7f57a8800640 1 -- start start 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.627+0000 7f57a8800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 0x7f57a00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.627+0000 7f57a8800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 0x7f57a006e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a8800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a00afc10 con 0x7f57a0155180 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a8800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a006ea40 con 0x7f57a006e080 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a8800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00af000 con 0x7f57a0155550 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a6800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 0x7f57a006e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 0x7f57a00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a6800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 0x7f57a006e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50690/0 (socket says 172.21.15.146:50690) 2024-08-17T02:25:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a6800640 1 -- 172.21.15.146:0/3537228204 learned_addr learned my addr 172.21.15.146:0/3537228204 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5e00640 1 --1- 172.21.15.146:0/3537228204 >> v1:172.21.15.150:6789/0 conn(0x7f57a0155180 0x7f57a00ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:41180/0 (socket says 172.21.15.146:41180) 2024-08-17T02:25:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5400640 1 -- 172.21.15.146:0/3537228204 >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 msgr2=0x7f57a006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5400640 1 --2- 172.21.15.146:0/3537228204 >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 0x7f57a006e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5400640 1 -- 172.21.15.146:0/3537228204 >> v1:172.21.15.150:6789/0 conn(0x7f57a0155180 legacy=0x7f57a00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.628+0000 7f57a5400640 1 -- 172.21.15.146:0/3537228204 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00af2e0 con 0x7f57a0155550 2024-08-17T02:25:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.629+0000 7f57a5400640 1 --2- 172.21.15.146:0/3537228204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 0x7f57a00aea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5790009850 tx=0x7f57900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6df8db3e2252cde server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a4a00640 1 -- 172.21.15.146:0/3537228204 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579002ad90 con 0x7f57a0155550 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a4a00640 1 -- 172.21.15.146:0/3537228204 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790032440 con 0x7f57a0155550 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a4a00640 1 -- 172.21.15.146:0/3537228204 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790032820 con 0x7f57a0155550 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 -- 172.21.15.146:0/3537228204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 msgr2=0x7f57a00aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 --2- 172.21.15.146:0/3537228204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 0x7f57a00aea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5790009850 tx=0x7f57900090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 -- 172.21.15.146:0/3537228204 shutdown_connections 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 --2- 172.21.15.146:0/3537228204 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a0155550 0x7f57a00aea20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 --2- 172.21.15.146:0/3537228204 >> v2:172.21.15.150:3300/0 conn(0x7f57a006e080 0x7f57a006e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.630+0000 7f57a8800640 1 -- 172.21.15.146:0/3537228204 >> 172.21.15.146:0/3537228204 conn(0x7f57a00cb9b0 msgr2=0x7f57a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.631+0000 7f57a8800640 1 -- 172.21.15.146:0/3537228204 shutdown_connections 2024-08-17T02:25:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.631+0000 7f57a8800640 1 -- 172.21.15.146:0/3537228204 wait complete. 2024-08-17T02:25:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.632+0000 7f57a8800640 1 Processor -- start 2024-08-17T02:25:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.632+0000 7f57a8800640 1 -- start start 2024-08-17T02:25:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a0155550 0x7f57a00c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0165f20 con 0x7f57a0155180 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00ca000 con 0x7f57a0155550 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a8800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c96d0 con 0x7f57a006e080 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:38636/0 (socket says 172.21.15.146:38636) 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a5e00640 1 -- 172.21.15.146:0/2538978970 learned_addr learned my addr 172.21.15.146:0/2538978970 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57204/0 (socket says 172.21.15.146:57204) 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.633+0000 7f57a6800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a0155550 0x7f57a00c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 -- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 msgr2=0x7f57a0166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 -- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a0155550 msgr2=0x7f57a00c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a0155550 0x7f57a00c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 -- 172.21.15.146:0/2538978970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009390 con 0x7f57a0155180 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5e00640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a5400640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57a00ccaa0 tx=0x7f5790032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790031de0 con 0x7f57a0155180 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579003e450 con 0x7f57a0155180 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579003e850 con 0x7f57a0155180 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00c99b0 con 0x7f57a0155180 2024-08-17T02:25:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.634+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a0158720 con 0x7f57a0155180 2024-08-17T02:25:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.635+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a00ca190 con 0x7f57a0155180 2024-08-17T02:25:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.636+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f579003c400 con 0x7f57a0155180 2024-08-17T02:25:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.637+0000 7f5799600640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 0x7f5784067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.637+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f57900a2810 con 0x7f57a0155180 2024-08-17T02:25:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.637+0000 7f57a5e00640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 0x7f5784067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.638+0000 7f57a5e00640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 0x7f5784067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5794001780 tx=0x7f5794007f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.642+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5790070c30 con 0x7f57a0155180 2024-08-17T02:25:59.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.852+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57a0064db0 con 0x7f57a0155180 2024-08-17T02:25:59.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.852+0000 7f5799600640 1 -- 172.21.15.146:0/2538978970 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7f5790043de0 con 0x7f57a0155180 2024-08-17T02:25:59.853 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:25:59.853 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:25:59.853 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 3 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.854+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 msgr2=0x7f5784067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.854+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 0x7f5784067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5794001780 tx=0x7f5794007f90 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.854+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 msgr2=0x7f57a0164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.854+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f57a00ccaa0 tx=0x7f5790032000 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 shutdown_connections 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5784065150 0x7f5784067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57a0155180 0x7f57a0164720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f57a0155550 0x7f57a00c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 --2- 172.21.15.146:0/2538978970 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57a006e080 0x7f57a0166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 >> 172.21.15.146:0/2538978970 conn(0x7f57a00cb9b0 msgr2=0x7f57a0151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 shutdown_connections 2024-08-17T02:25:59.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:25:59.855+0000 7f57a8800640 1 -- 172.21.15.146:0/2538978970 wait complete. 2024-08-17T02:25:59.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.019+0000 7fd29c800640 1 Processor -- start 2024-08-17T02:26:00.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.019+0000 7fd29c800640 1 -- start start 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.020+0000 7fd29c800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd294155a20 0x7fd2940adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd29c800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd294156670 con 0x7fd294155df0 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd29c800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29406e5e0 con 0x7fd29406df00 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd29c800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940b0350 con 0x7fd294155a20 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd294155a20 0x7fd2940adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd294155a20 0x7fd2940adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57208/0 (socket says 172.21.15.146:57208) 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd294155df0 0x7fd29406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54618/0 (socket says 172.21.15.146:54618) 2024-08-17T02:26:00.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 -- 172.21.15.146:0/2224891798 learned_addr learned my addr 172.21.15.146:0/2224891798 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 -- 172.21.15.146:0/2224891798 >> v1:172.21.15.150:6789/0 conn(0x7fd29406df00 legacy=0x7fd294156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 -- 172.21.15.146:0/2224891798 >> v1:172.21.15.146:6789/0 conn(0x7fd294155df0 legacy=0x7fd29406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd299e00640 1 -- 172.21.15.146:0/2224891798 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29406e8c0 con 0x7fd294155a20 2024-08-17T02:26:00.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.021+0000 7fd298a00640 1 -- 172.21.15.146:0/2224891798 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189734057 0 0) 0x7fd294156670 con 0x7fd294155df0 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.022+0000 7fd299e00640 1 --2- 172.21.15.146:0/2224891798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2940adf10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd288009910 tx=0x7fd2880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797b9ae95e0208da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.022+0000 7fd298a00640 1 -- 172.21.15.146:0/2224891798 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28802ae60 con 0x7fd294155a20 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.022+0000 7fd298a00640 1 -- 172.21.15.146:0/2224891798 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288032440 con 0x7fd294155a20 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.022+0000 7fd298a00640 1 -- 172.21.15.146:0/2224891798 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880327e0 con 0x7fd294155a20 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 -- 172.21.15.146:0/2224891798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 msgr2=0x7fd2940adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 --2- 172.21.15.146:0/2224891798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2940adf10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd288009910 tx=0x7fd2880091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 -- 172.21.15.146:0/2224891798 shutdown_connections 2024-08-17T02:26:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 --2- 172.21.15.146:0/2224891798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2940adf10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 -- 172.21.15.146:0/2224891798 >> 172.21.15.146:0/2224891798 conn(0x7fd2940cb9b0 msgr2=0x7fd2940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 -- 172.21.15.146:0/2224891798 shutdown_connections 2024-08-17T02:26:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.023+0000 7fd29c800640 1 -- 172.21.15.146:0/2224891798 wait complete. 2024-08-17T02:26:00.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.025+0000 7fd29c800640 1 Processor -- start 2024-08-17T02:26:00.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.025+0000 7fd29c800640 1 -- start start 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.025+0000 7fd29c800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd29406df00 0x7fd29414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29c800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29c800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 0x7fd294141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29c800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294147dd0 con 0x7fd294155a20 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29c800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941480b0 con 0x7fd294155df0 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29c800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd294148390 con 0x7fd29406df00 2024-08-17T02:26:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57214/0 (socket says 172.21.15.146:57214) 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 -- 172.21.15.146:0/1934913766 learned_addr learned my addr 172.21.15.146:0/1934913766 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 -- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd29406df00 msgr2=0x7fd29414b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd29406df00 0x7fd29414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 -- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 msgr2=0x7fd294141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29a800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 0x7fd294141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 0x7fd294141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 -- 172.21.15.146:0/1934913766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009450 con 0x7fd294155a20 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd29a800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 0x7fd294141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.026+0000 7fd299400640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c510 tx=0x7fd284007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.027+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840072e0 con 0x7fd294155a20 2024-08-17T02:26:00.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.027+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd284007460 con 0x7fd294155a20 2024-08-17T02:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.027+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840047a0 con 0x7fd294155a20 2024-08-17T02:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.027+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd294148670 con 0x7fd294155a20 2024-08-17T02:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.027+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29414da60 con 0x7fd294155a20 2024-08-17T02:26:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.028+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd294064db0 con 0x7fd294155a20 2024-08-17T02:26:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.029+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd284004bf0 con 0x7fd294155a20 2024-08-17T02:26:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.029+0000 7fd28d600640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 0x7fd278067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.030+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd284081b10 con 0x7fd294155a20 2024-08-17T02:26:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.030+0000 7fd299e00640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 0x7fd278067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.030+0000 7fd299e00640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 0x7fd278067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd288034000 tx=0x7fd288032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.033+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd28404ff30 con 0x7fd294155a20 2024-08-17T02:26:00.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.209+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd29414ab30 con 0x7fd294155a20 2024-08-17T02:26:00.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.210+0000 7fd28d600640 1 -- 172.21.15.146:0/1934913766 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fd284053550 con 0x7fd294155a20 2024-08-17T02:26:00.210 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:00.210 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:25:52.513854+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:00.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 msgr2=0x7fd278067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 0x7fd278067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd288034000 tx=0x7fd288032000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 msgr2=0x7fd2941473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c510 tx=0x7fd284007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 shutdown_connections 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd278065150 0x7fd278067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd294155a20 0x7fd2941473c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd294155df0 0x7fd294141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 --2- 172.21.15.146:0/1934913766 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd29406df00 0x7fd29414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 >> 172.21.15.146:0/1934913766 conn(0x7fd2940cb9b0 msgr2=0x7fd2940687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 shutdown_connections 2024-08-17T02:26:00.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.212+0000 7fd29c800640 1 -- 172.21.15.146:0/1934913766 wait complete. 2024-08-17T02:26:00.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:00.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:00.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.381+0000 7fdf88200640 1 Processor -- start 2024-08-17T02:26:00.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.381+0000 7fdf88200640 1 -- start start 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf88200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdf800afd90 0x7fdf800b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf88200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800ae540 con 0x7fdf80159610 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf88200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800ad930 con 0x7fdf800accf0 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf88200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf800adc10 con 0x7fdf800afd90 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf86200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdf80159610 0x7fdf80157690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54624/0 (socket says 172.21.15.146:54624) 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf86200640 1 -- 172.21.15.146:0/2071251463 learned_addr learned my addr 172.21.15.146:0/2071251463 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:00.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.382+0000 7fdf84e00640 1 --2- 172.21.15.146:0/2071251463 >> v2:172.21.15.150:3300/0 conn(0x7fdf800afd90 0x7fdf800b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440965412 0 0) 0x7fdf800ae540 con 0x7fdf80159610 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf680034e0 con 0x7fdf80159610 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376689009 0 0) 0x7fdf800ad930 con 0x7fdf800accf0 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf800ae540 con 0x7fdf800accf0 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf84e00640 1 -- 172.21.15.146:0/2071251463 >> v1:172.21.15.150:6789/0 conn(0x7fdf800accf0 legacy=0x7fdf800af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf84e00640 1 -- 172.21.15.146:0/2071251463 >> v1:172.21.15.146:6789/0 conn(0x7fdf80159610 legacy=0x7fdf80157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.383+0000 7fdf84e00640 1 -- 172.21.15.146:0/2071251463 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800adef0 con 0x7fdf800afd90 2024-08-17T02:26:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.384+0000 7fdf84e00640 1 --2- 172.21.15.146:0/2071251463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf800afd90 0x7fdf800b1670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009850 tx=0x7fdf6c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b378a6469e01e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.384+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c02ae20 con 0x7fdf800afd90 2024-08-17T02:26:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.384+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c032440 con 0x7fdf800afd90 2024-08-17T02:26:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.384+0000 7fdf7fe00640 1 -- 172.21.15.146:0/2071251463 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0327e0 con 0x7fdf800afd90 2024-08-17T02:26:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 -- 172.21.15.146:0/2071251463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf800afd90 msgr2=0x7fdf800b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 --2- 172.21.15.146:0/2071251463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf800afd90 0x7fdf800b1670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009850 tx=0x7fdf6c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 -- 172.21.15.146:0/2071251463 shutdown_connections 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 --2- 172.21.15.146:0/2071251463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf800afd90 0x7fdf800b1670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 -- 172.21.15.146:0/2071251463 >> 172.21.15.146:0/2071251463 conn(0x7fdf80067750 msgr2=0x7fdf800cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 -- 172.21.15.146:0/2071251463 shutdown_connections 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.385+0000 7fdf88200640 1 -- 172.21.15.146:0/2071251463 wait complete. 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.386+0000 7fdf88200640 1 Processor -- start 2024-08-17T02:26:00.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.386+0000 7fdf88200640 1 -- start start 2024-08-17T02:26:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf800afd90 0x7fdf801546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 0x7fdf80151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800c1180 con 0x7fdf800accf0 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800aa060 con 0x7fdf80159610 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf88200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800c0ea0 con 0x7fdf800afd90 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.387+0000 7fdf85800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57230/0 (socket says 172.21.15.146:57230) 2024-08-17T02:26:00.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 -- 172.21.15.146:0/3823021217 learned_addr learned my addr 172.21.15.146:0/3823021217 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf84e00640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf800afd90 0x7fdf801546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf86200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 0x7fdf80151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 -- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf800afd90 msgr2=0x7fdf801546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf800afd90 0x7fdf801546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 -- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 msgr2=0x7fdf80151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 0x7fdf80151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 -- 172.21.15.146:0/3823021217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009390 con 0x7fdf800accf0 2024-08-17T02:26:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf86200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 0x7fdf80151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf85800640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c5c0 tx=0x7fdf74007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74012630 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf740127b0 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf800a9a10 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.388+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74012b70 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.389+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf800ac1b0 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.390+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf80064db0 con 0x7fdf800accf0 2024-08-17T02:26:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.390+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf7401a3b0 con 0x7fdf800accf0 2024-08-17T02:26:00.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.391+0000 7fdf7cc00640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 0x7fdf60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.391+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdf740820c0 con 0x7fdf800accf0 2024-08-17T02:26:00.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.391+0000 7fdf84e00640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 0x7fdf60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.392+0000 7fdf84e00640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 0x7fdf60067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c034000 tx=0x7fdf6c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.395+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf74050430 con 0x7fdf800accf0 2024-08-17T02:26:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.568+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf800cc480 con 0x7fdf800accf0 2024-08-17T02:26:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.568+0000 7fdf7cc00640 1 -- 172.21.15.146:0/3823021217 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf74053a50 con 0x7fdf800accf0 2024-08-17T02:26:00.569 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 msgr2=0x7fdf60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 0x7fdf60067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c034000 tx=0x7fdf6c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 msgr2=0x7fdf800aa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400c5c0 tx=0x7fdf74007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 shutdown_connections 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fdf60065150 0x7fdf60067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf80159610 0x7fdf80151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdf800afd90 0x7fdf801546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 --2- 172.21.15.146:0/3823021217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf800accf0 0x7fdf800aa4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.570+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 >> 172.21.15.146:0/3823021217 conn(0x7fdf80067750 msgr2=0x7fdf80069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.571+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 shutdown_connections 2024-08-17T02:26:00.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.571+0000 7fdf88200640 1 -- 172.21.15.146:0/3823021217 wait complete. 2024-08-17T02:26:00.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:00.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.734+0000 7efc5be00640 1 Processor -- start 2024-08-17T02:26:00.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.734+0000 7efc5be00640 1 -- start start 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.735+0000 7efc5be00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efc5c06d7a0 0x7efc5c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.735+0000 7efc5be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c0cbea0 0x7efc5c0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc5c15d4b0 0x7efc5c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0cc2b0 con 0x7efc5c15d4b0 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5be00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0aa0d0 con 0x7efc5c06d7a0 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0cc4f0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc5c15d4b0 0x7efc5c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc5c15d4b0 0x7efc5c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57236/0 (socket says 172.21.15.146:57236) 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 -- 172.21.15.146:0/1883064942 learned_addr learned my addr 172.21.15.146:0/1883064942 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5aa00640 1 --2- 172.21.15.146:0/1883064942 >> v2:172.21.15.150:3300/0 conn(0x7efc5c06d7a0 0x7efc5c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5a000640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c0cbea0 0x7efc5c0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 -- 172.21.15.146:0/1883064942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c0cbea0 msgr2=0x7efc5c0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c0cbea0 0x7efc5c0aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 -- 172.21.15.146:0/1883064942 >> v2:172.21.15.150:3300/0 conn(0x7efc5c06d7a0 msgr2=0x7efc5c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 --2- 172.21.15.146:0/1883064942 >> v2:172.21.15.150:3300/0 conn(0x7efc5c06d7a0 0x7efc5c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.736+0000 7efc5b400640 1 -- 172.21.15.146:0/1883064942 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0a9a80 con 0x7efc5c15d4b0 2024-08-17T02:26:00.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.737+0000 7efc5b400640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c15d4b0 0x7efc5c1588a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc5c06bf70 tx=0x7efc54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a4537890381443 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.737+0000 7efc59600640 1 -- 172.21.15.146:0/1883064942 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5402e050 con 0x7efc5c15d4b0 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.737+0000 7efc59600640 1 -- 172.21.15.146:0/1883064942 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc54007400 con 0x7efc5c15d4b0 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.737+0000 7efc59600640 1 -- 172.21.15.146:0/1883064942 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc540077e0 con 0x7efc5c15d4b0 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 -- 172.21.15.146:0/1883064942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c15d4b0 msgr2=0x7efc5c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c15d4b0 0x7efc5c1588a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc5c06bf70 tx=0x7efc54009840 comp rx=0 tx=0).stop 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 -- 172.21.15.146:0/1883064942 shutdown_connections 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c15d4b0 0x7efc5c1588a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 --2- 172.21.15.146:0/1883064942 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c0cbea0 0x7efc5c0aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 --2- 172.21.15.146:0/1883064942 >> v2:172.21.15.150:3300/0 conn(0x7efc5c06d7a0 0x7efc5c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 -- 172.21.15.146:0/1883064942 >> 172.21.15.146:0/1883064942 conn(0x7efc5c067750 msgr2=0x7efc5c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 -- 172.21.15.146:0/1883064942 shutdown_connections 2024-08-17T02:26:00.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.738+0000 7efc5be00640 1 -- 172.21.15.146:0/1883064942 wait complete. 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.739+0000 7efc5be00640 1 Processor -- start 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 -- start start 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c06d7a0 0x7efc5c0c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5c15d4b0 0x7efc5c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c15b5a0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c15a990 con 0x7efc5c15d4b0 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.740+0000 7efc5be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c15ac70 con 0x7efc5c06d7a0 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c06d7a0 0x7efc5c0c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57248/0 (socket says 172.21.15.146:57248) 2024-08-17T02:26:00.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 -- 172.21.15.146:0/1986088016 learned_addr learned my addr 172.21.15.146:0/1986088016 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:00.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5b400640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5c15d4b0 0x7efc5c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 -- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c06d7a0 msgr2=0x7efc5c0c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c06d7a0 0x7efc5c0c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 -- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5c15d4b0 msgr2=0x7efc5c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5c15d4b0 0x7efc5c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 -- 172.21.15.146:0/1986088016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54009ae0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc5a000640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc4800d890 tx=0x7efc48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.741+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800de20 con 0x7efc5c0cbea0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.742+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4800b8d0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.742+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4800bc70 con 0x7efc5c0cbea0 2024-08-17T02:26:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.742+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c15af50 con 0x7efc5c0cbea0 2024-08-17T02:26:00.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.742+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c0c0c50 con 0x7efc5c0cbea0 2024-08-17T02:26:00.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.743+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c071050 con 0x7efc5c0cbea0 2024-08-17T02:26:00.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.743+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc48014640 con 0x7efc5c0cbea0 2024-08-17T02:26:00.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.745+0000 7efc52000640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.745+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efc480826b0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.745+0000 7efc5aa00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.745+0000 7efc5aa00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 0x7efc3c067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc4c007ba0 tx=0x7efc4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.749+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc48050b90 con 0x7efc5c0cbea0 2024-08-17T02:26:00.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.923+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efc5c06a770 con 0x7efc5c0cbea0 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.923+0000 7efc52000640 1 -- 172.21.15.146:0/1986088016 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7efc480541b0 con 0x7efc5c0cbea0 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:00.924 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.925+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 msgr2=0x7efc3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.925+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 0x7efc3c067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc4c007ba0 tx=0x7efc4c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.925+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 msgr2=0x7efc5c0ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.925+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efc4800d890 tx=0x7efc48008040 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 shutdown_connections 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc5c0cbea0 0x7efc5c0ae8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc5c15d4b0 0x7efc5c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 --2- 172.21.15.146:0/1986088016 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efc5c06d7a0 0x7efc5c0c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 >> 172.21.15.146:0/1986088016 conn(0x7efc5c067750 msgr2=0x7efc5c156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 shutdown_connections 2024-08-17T02:26:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:00.926+0000 7efc5be00640 1 -- 172.21.15.146:0/1986088016 wait complete. 2024-08-17T02:26:00.941 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:00.941 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:01.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.094+0000 7f54a9000640 1 Processor -- start 2024-08-17T02:26:01.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.095+0000 7f54a9000640 1 -- start start 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a9000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54a41543a0 0x7f54a40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a9000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a406e3e0 0x7f54a4157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a9000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a4157eb0 con 0x7f54a4154770 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a9000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40ca160 con 0x7f54a41543a0 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a9000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40ca440 con 0x7f54a406e3e0 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a3400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54a41543a0 0x7f54a40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a3400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54a41543a0 0x7f54a40cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50732/0 (socket says 172.21.15.146:50732) 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a3400640 1 -- 172.21.15.146:0/1490833757 learned_addr learned my addr 172.21.15.146:0/1490833757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.096+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a406e3e0 0x7f54a4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.097+0000 7f54a3400640 1 -- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a406e3e0 msgr2=0x7f54a4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.097+0000 7f54a3400640 1 --2- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a406e3e0 0x7f54a4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.097+0000 7f54a3400640 1 -- 172.21.15.146:0/1490833757 >> v1:172.21.15.150:6789/0 conn(0x7f54a4154770 legacy=0x7f54a406dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.097+0000 7f54a3400640 1 -- 172.21.15.146:0/1490833757 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40ca720 con 0x7f54a41543a0 2024-08-17T02:26:01.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.097+0000 7f54a2a00640 1 -- 172.21.15.146:0/1490833757 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438694742 0 0) 0x7f54a4157eb0 con 0x7f54a4154770 2024-08-17T02:26:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.098+0000 7f54a3400640 1 --2- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a41543a0 0x7f54a40cb200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5494009910 tx=0x7f54940091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9889a22a85f94af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.098+0000 7f54a2a00640 1 -- 172.21.15.146:0/1490833757 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549402ae40 con 0x7f54a41543a0 2024-08-17T02:26:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.098+0000 7f54a2a00640 1 -- 172.21.15.146:0/1490833757 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5494032440 con 0x7f54a41543a0 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.098+0000 7f54a2a00640 1 -- 172.21.15.146:0/1490833757 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54940327e0 con 0x7f54a41543a0 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 -- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a41543a0 msgr2=0x7f54a40cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 --2- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a41543a0 0x7f54a40cb200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5494009910 tx=0x7f54940091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 -- 172.21.15.146:0/1490833757 shutdown_connections 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 --2- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a406e3e0 0x7f54a4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 --2- 172.21.15.146:0/1490833757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a41543a0 0x7f54a40cb200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 -- 172.21.15.146:0/1490833757 >> 172.21.15.146:0/1490833757 conn(0x7f54a4067750 msgr2=0x7f54a406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 -- 172.21.15.146:0/1490833757 shutdown_connections 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.099+0000 7f54a9000640 1 -- 172.21.15.146:0/1490833757 wait complete. 2024-08-17T02:26:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.101+0000 7f54a9000640 1 Processor -- start 2024-08-17T02:26:01.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.101+0000 7f54a9000640 1 -- start start 2024-08-17T02:26:01.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 0x7f54a4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a41543a0 0x7f54a414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4168230 con 0x7f54a4154770 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4155b50 con 0x7f54a406e3e0 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a9000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4155e30 con 0x7f54a41543a0 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 0x7f54a4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57264/0 (socket says 172.21.15.146:57264) 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 -- 172.21.15.146:0/3262436255 learned_addr learned my addr 172.21.15.146:0/3262436255 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f549aa00640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a41543a0 0x7f54a414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 -- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a41543a0 msgr2=0x7f54a414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a41543a0 0x7f54a414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 -- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 msgr2=0x7f54a4155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 0x7f54a4155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3e00640 1 -- 172.21.15.146:0/3262436255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009450 con 0x7f54a4154770 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.102+0000 7f54a3400640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 0x7f54a4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f54a3e00640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ec0 tx=0x7f549c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00ce10 con 0x7f54a4154770 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c00f040 con 0x7f54a4154770 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0146d0 con 0x7f54a4154770 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a4156110 con 0x7f54a4154770 2024-08-17T02:26:01.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.103+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a414b5a0 con 0x7f54a4154770 2024-08-17T02:26:01.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.104+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4071050 con 0x7f54a4154770 2024-08-17T02:26:01.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.105+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f549c014a40 con 0x7f54a4154770 2024-08-17T02:26:01.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.106+0000 7f549b400640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 0x7f5480067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.106+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f549c082e60 con 0x7f54a4154770 2024-08-17T02:26:01.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.106+0000 7f54a3400640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 0x7f5480067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.107+0000 7f54a3400640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 0x7f5480067630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5494034000 tx=0x7f5494032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.110+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f549c051340 con 0x7f54a4154770 2024-08-17T02:26:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.284+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f54a40b0f30 con 0x7f54a4154770 2024-08-17T02:26:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.658+0000 7f549b400640 1 -- 172.21.15.146:0/3262436255 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f549c0180b0 con 0x7f54a4154770 2024-08-17T02:26:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:01.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 msgr2=0x7f5480067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 0x7f5480067630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5494034000 tx=0x7f5494032000 comp rx=0 tx=0).stop 2024-08-17T02:26:01.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 msgr2=0x7f54a4167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ec0 tx=0x7f549c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 shutdown_connections 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5480065180 0x7f5480067630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a4154770 0x7f54a4167180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54a41543a0 0x7f54a414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 --2- 172.21.15.146:0/3262436255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54a406e3e0 0x7f54a4155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 >> 172.21.15.146:0/3262436255 conn(0x7f54a4067750 msgr2=0x7f54a4149aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 shutdown_connections 2024-08-17T02:26:01.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.663+0000 7f54a9000640 1 -- 172.21.15.146:0/3262436255 wait complete. 2024-08-17T02:26:01.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.837+0000 7f53e1400640 1 Processor -- start 2024-08-17T02:26:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.837+0000 7f53e1400640 1 -- start start 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53e1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53dc06e5f0 0x7f53dc0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53e1400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0ae9b0 con 0x7f53dc156890 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53e1400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc0ab320 con 0x7f53dc156c60 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53e1400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc0aa730 con 0x7f53dc06e5f0 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53da800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f53dc156890 0x7f53dc06dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54636/0 (socket says 172.21.15.146:54636) 2024-08-17T02:26:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53da800640 1 -- 172.21.15.146:0/2576359761 learned_addr learned my addr 172.21.15.146:0/2576359761 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.838+0000 7f53d3e00640 1 --2- 172.21.15.146:0/2576359761 >> v2:172.21.15.146:3300/0 conn(0x7f53dc06e5f0 0x7f53dc0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.839+0000 7f53d9e00640 1 -- 172.21.15.146:0/2576359761 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856081792 0 0) 0x7f53dc0ae9b0 con 0x7f53dc156890 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.839+0000 7f53d9e00640 1 -- 172.21.15.146:0/2576359761 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53c00034e0 con 0x7f53dc156890 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.839+0000 7f53d3e00640 1 -- 172.21.15.146:0/2576359761 >> v1:172.21.15.150:6789/0 conn(0x7f53dc156c60 legacy=0x7f53dc0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.839+0000 7f53d3e00640 1 -- 172.21.15.146:0/2576359761 >> v1:172.21.15.146:6789/0 conn(0x7f53dc156890 legacy=0x7f53dc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.839+0000 7f53d3e00640 1 -- 172.21.15.146:0/2576359761 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0aa9f0 con 0x7f53dc06e5f0 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53d3e00640 1 --2- 172.21.15.146:0/2576359761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc06e5f0 0x7f53dc0c8130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009850 tx=0x7f53c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da038a46d4ee9de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53d9e00640 1 -- 172.21.15.146:0/2576359761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c402ad90 con 0x7f53dc06e5f0 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53d9e00640 1 -- 172.21.15.146:0/2576359761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4032440 con 0x7f53dc06e5f0 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53d9e00640 1 -- 172.21.15.146:0/2576359761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c40327e0 con 0x7f53dc06e5f0 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53e1400640 1 -- 172.21.15.146:0/2576359761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc06e5f0 msgr2=0x7f53dc0c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.840+0000 7f53e1400640 1 --2- 172.21.15.146:0/2576359761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc06e5f0 0x7f53dc0c8130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009850 tx=0x7f53c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.841+0000 7f53e1400640 1 -- 172.21.15.146:0/2576359761 shutdown_connections 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.841+0000 7f53e1400640 1 --2- 172.21.15.146:0/2576359761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc06e5f0 0x7f53dc0c8130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.841+0000 7f53e1400640 1 -- 172.21.15.146:0/2576359761 >> 172.21.15.146:0/2576359761 conn(0x7f53dc067750 msgr2=0x7f53dc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.841+0000 7f53e1400640 1 -- 172.21.15.146:0/2576359761 shutdown_connections 2024-08-17T02:26:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.841+0000 7f53e1400640 1 -- 172.21.15.146:0/2576359761 wait complete. 2024-08-17T02:26:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.842+0000 7f53e1400640 1 Processor -- start 2024-08-17T02:26:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.842+0000 7f53e1400640 1 -- start start 2024-08-17T02:26:01.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 0x7f53dc150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53dc156890 0x7f53dc06a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc16a8b0 con 0x7f53dc156c60 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc16ab50 con 0x7f53dc156890 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53e1400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc16ae30 con 0x7f53dc06e5f0 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53db200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53db200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57288/0 (socket says 172.21.15.146:57288) 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53da800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 0x7f53dc150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53db200640 1 -- 172.21.15.146:0/453202054 learned_addr learned my addr 172.21.15.146:0/453202054 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.843+0000 7f53d3e00640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53dc156890 0x7f53dc06a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 -- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 msgr2=0x7f53dc150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 0x7f53dc150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 -- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53dc156890 msgr2=0x7f53dc06a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53dc156890 0x7f53dc06a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 -- 172.21.15.146:0/453202054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4009390 con 0x7f53dc156c60 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53da800640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 0x7f53dc150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53db200640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7c0 tx=0x7f53d40015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400a640 con 0x7f53dc156c60 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400a7c0 con 0x7f53dc156c60 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc16b110 con 0x7f53dc156c60 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.844+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400ab80 con 0x7f53dc156c60 2024-08-17T02:26:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.845+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc14c630 con 0x7f53dc156c60 2024-08-17T02:26:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.846+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc0710c0 con 0x7f53dc156c60 2024-08-17T02:26:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.847+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f53d4003030 con 0x7f53dc156c60 2024-08-17T02:26:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.847+0000 7f53d2000640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 0x7f53b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.847+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f53d4082080 con 0x7f53dc156c60 2024-08-17T02:26:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.848+0000 7f53da800640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 0x7f53b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.848+0000 7f53da800640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 0x7f53b8067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005840 tx=0x7f53cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:01.852+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53d40503d0 con 0x7f53dc156c60 2024-08-17T02:26:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.025+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f53dc15bb50 con 0x7f53dc156c60 2024-08-17T02:26:02.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.669+0000 7f53d2000640 1 -- 172.21.15.146:0/453202054 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f53d40539f0 con 0x7f53dc156c60 2024-08-17T02:26:02.673 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-08-17T02:26:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.673+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 msgr2=0x7f53b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.673+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 0x7f53b8067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005840 tx=0x7f53cc009040 comp rx=0 tx=0).stop 2024-08-17T02:26:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.673+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 msgr2=0x7f53dc147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.673+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c7c0 tx=0x7f53d40015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 shutdown_connections 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f53b8065150 0x7f53b8067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53dc156c60 0x7f53dc147210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53dc156890 0x7f53dc06a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 --2- 172.21.15.146:0/453202054 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53dc06e5f0 0x7f53dc150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 >> 172.21.15.146:0/453202054 conn(0x7f53dc067750 msgr2=0x7f53dc155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 shutdown_connections 2024-08-17T02:26:02.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.674+0000 7f53e1400640 1 -- 172.21.15.146:0/453202054 wait complete. 2024-08-17T02:26:02.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:02.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.851+0000 7f8fde200640 1 Processor -- start 2024-08-17T02:26:02.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.851+0000 7f8fde200640 1 -- start start 2024-08-17T02:26:02.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fde200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8fd80ce250 0x7f8fd80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fde200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd80b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fde200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80c5a40 con 0x7f8fd80cb980 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fde200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80b2eb0 con 0x7f8fd80ce250 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fde200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80c4e30 con 0x7f8fd80c4950 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fdce00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8fd80ce250 0x7f8fd80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fcfe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd80b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.852+0000 7f8fdce00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8fd80ce250 0x7f8fd80ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50766/0 (socket says 172.21.15.146:50766) 2024-08-17T02:26:02.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fdce00640 1 -- 172.21.15.146:0/3543741530 learned_addr learned my addr 172.21.15.146:0/3543741530 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fdce00640 1 -- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 msgr2=0x7f8fd80b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd80b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fdce00640 1 -- 172.21.15.146:0/3543741530 >> v1:172.21.15.150:6789/0 conn(0x7f8fd80cb980 legacy=0x7f8fd8158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fdce00640 1 -- 172.21.15.146:0/3543741530 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80c5110 con 0x7f8fd80ce250 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.853+0000 7f8fcfe00640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:02.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.854+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80ce620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009910 tx=0x7f8fc80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63403e259060d564 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.854+0000 7f8fd7e00640 1 -- 172.21.15.146:0/3543741530 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc802add0 con 0x7f8fd80ce250 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.854+0000 7f8fd7e00640 1 -- 172.21.15.146:0/3543741530 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8032440 con 0x7f8fd80ce250 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.854+0000 7f8fd7e00640 1 -- 172.21.15.146:0/3543741530 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8032820 con 0x7f8fd80ce250 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 -- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 msgr2=0x7f8fd80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80ce620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009910 tx=0x7f8fc80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 -- 172.21.15.146:0/3543741530 shutdown_connections 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd80b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 --2- 172.21.15.146:0/3543741530 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80ce620 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 -- 172.21.15.146:0/3543741530 >> 172.21.15.146:0/3543741530 conn(0x7f8fd8098e30 msgr2=0x7f8fd806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 -- 172.21.15.146:0/3543741530 shutdown_connections 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.855+0000 7f8fde200640 1 -- 172.21.15.146:0/3543741530 wait complete. 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.856+0000 7f8fde200640 1 Processor -- start 2024-08-17T02:26:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.856+0000 7f8fde200640 1 -- start start 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814ecd0 con 0x7f8fd80cb980 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81567f0 con 0x7f8fd80ce250 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.857+0000 7f8fde200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80c9e30 con 0x7f8fd80c4950 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57298/0 (socket says 172.21.15.146:57298) 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 -- 172.21.15.146:0/3235672531 learned_addr learned my addr 172.21.15.146:0/3235672531 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fdd800640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 -- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 msgr2=0x7f8fd8156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd8156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 -- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 msgr2=0x7f8fd80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 -- 172.21.15.146:0/3235672531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc0009390 con 0x7f8fd80cb980 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fcfe00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000ecb0 tx=0x7f8fc00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.858+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc000cbc0 con 0x7f8fd80cb980 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.859+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc000cd20 con 0x7f8fd80cb980 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.859+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc8009450 con 0x7f8fd80cb980 2024-08-17T02:26:02.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.859+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00136a0 con 0x7f8fd80cb980 2024-08-17T02:26:02.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.859+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8155ec0 con 0x7f8fd80cb980 2024-08-17T02:26:02.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.860+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8071050 con 0x7f8fd80cb980 2024-08-17T02:26:02.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.861+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8fc0013a50 con 0x7f8fd80cb980 2024-08-17T02:26:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.862+0000 7f8fd4c00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 0x7f8fb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.862+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8fc00825b0 con 0x7f8fd80cb980 2024-08-17T02:26:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.862+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 0x7f8fb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.863+0000 7f8fdce00640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 0x7f8fb4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:02.867+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8fc0050630 con 0x7f8fd80cb980 2024-08-17T02:26:03.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.076+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8fd8068340 con 0x7f8fd80cb980 2024-08-17T02:26:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.670+0000 7f8fd4c00640 1 -- 172.21.15.146:0/3235672531 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8fc0053c50 con 0x7f8fd80cb980 2024-08-17T02:26:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:26:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.676+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 msgr2=0x7f8fb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.676+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 0x7f8fb4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8034000 tx=0x7f8fc8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.676+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 msgr2=0x7f8fd814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.676+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000ecb0 tx=0x7f8fc00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 shutdown_connections 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fb4065150 0x7f8fb4067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80cb980 0x7f8fd814e790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fd80ce250 0x7f8fd80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 --2- 172.21.15.146:0/3235672531 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fd80c4950 0x7f8fd8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 >> 172.21.15.146:0/3235672531 conn(0x7f8fd8098e30 msgr2=0x7f8fd8068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 shutdown_connections 2024-08-17T02:26:03.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.680+0000 7f8fde200640 1 -- 172.21.15.146:0/3235672531 wait complete. 2024-08-17T02:26:03.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:03.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.857+0000 7f1990200640 1 Processor -- start 2024-08-17T02:26:03.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.857+0000 7f1990200640 1 -- start start 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19881401b0 0x7f19880caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1988140580 0x7f19880b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19880b1270 0x7f19880c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880cb450 con 0x7f19881401b0 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880b16d0 con 0x7f19880b1270 2024-08-17T02:26:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f1990200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880caa80 con 0x7f1988140580 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f198d800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19881401b0 0x7f19880caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f198d800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19881401b0 0x7f19880caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57314/0 (socket says 172.21.15.146:57314) 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.858+0000 7f198d800640 1 -- 172.21.15.146:0/3658461733 learned_addr learned my addr 172.21.15.146:0/3658461733 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198e200640 1 --2- 172.21.15.146:0/3658461733 >> v2:172.21.15.150:3300/0 conn(0x7f19880b1270 0x7f19880c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198ce00640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1988140580 0x7f19880b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198d800640 1 -- 172.21.15.146:0/3658461733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1988140580 msgr2=0x7f19880b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198d800640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1988140580 0x7f19880b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198d800640 1 -- 172.21.15.146:0/3658461733 >> v2:172.21.15.150:3300/0 conn(0x7f19880b1270 msgr2=0x7f19880c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198d800640 1 --2- 172.21.15.146:0/3658461733 >> v2:172.21.15.150:3300/0 conn(0x7f19880b1270 0x7f19880c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.859+0000 7f198d800640 1 -- 172.21.15.146:0/3658461733 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880c9e70 con 0x7f19881401b0 2024-08-17T02:26:03.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f198d800640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19881401b0 0x7f19880caf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19880acbc0 tx=0x7f197c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c0cba067efbde6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f1987e00640 1 -- 172.21.15.146:0/3658461733 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c02ad40 con 0x7f19881401b0 2024-08-17T02:26:03.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f1987e00640 1 -- 172.21.15.146:0/3658461733 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c032440 con 0x7f19881401b0 2024-08-17T02:26:03.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f1987e00640 1 -- 172.21.15.146:0/3658461733 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c02aea0 con 0x7f19881401b0 2024-08-17T02:26:03.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f1990200640 1 -- 172.21.15.146:0/3658461733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19881401b0 msgr2=0x7f19880caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.860+0000 7f1990200640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19881401b0 0x7f19880caf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19880acbc0 tx=0x7f197c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 -- 172.21.15.146:0/3658461733 shutdown_connections 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 --2- 172.21.15.146:0/3658461733 >> v2:172.21.15.150:3300/0 conn(0x7f19880b1270 0x7f19880c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1988140580 0x7f19880b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 --2- 172.21.15.146:0/3658461733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19881401b0 0x7f19880caf10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 -- 172.21.15.146:0/3658461733 >> 172.21.15.146:0/3658461733 conn(0x7f19880cb9b0 msgr2=0x7f19880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 -- 172.21.15.146:0/3658461733 shutdown_connections 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.861+0000 7f1990200640 1 -- 172.21.15.146:0/3658461733 wait complete. 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.862+0000 7f1990200640 1 Processor -- start 2024-08-17T02:26:03.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.862+0000 7f1990200640 1 -- start start 2024-08-17T02:26:03.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19880b1270 0x7f19880c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881401b0 0x7f198815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198816c410 con 0x7f1988140580 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198816d270 con 0x7f19881401b0 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f1990200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198816c660 con 0x7f19880b1270 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f198e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f198e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57318/0 (socket says 172.21.15.146:57318) 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f198e200640 1 -- 172.21.15.146:0/2651817301 learned_addr learned my addr 172.21.15.146:0/2651817301 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f198ce00640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881401b0 0x7f198815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.863+0000 7f198d800640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19880b1270 0x7f19880c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 -- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19880b1270 msgr2=0x7f19880c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19880b1270 0x7f19880c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 -- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881401b0 msgr2=0x7f198815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881401b0 0x7f198815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 -- 172.21.15.146:0/2651817301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009450 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f198e200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1980007f20 tx=0x7f1980009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000ee30 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980014420 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198816c940 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800147e0 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.864+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198816cf00 con 0x7f1988140580 2024-08-17T02:26:03.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.865+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1988064db0 con 0x7f1988140580 2024-08-17T02:26:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.866+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1980014b50 con 0x7f1988140580 2024-08-17T02:26:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.867+0000 7f1984c00640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 0x7f1968067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.868+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1980082af0 con 0x7f1988140580 2024-08-17T02:26:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.868+0000 7f198d800640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 0x7f1968067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.868+0000 7f198d800640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 0x7f1968067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f197c034000 tx=0x7f197c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:03.872+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1980050bc0 con 0x7f1988140580 2024-08-17T02:26:04.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.046+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f198806dc70 con 0x7f1988140580 2024-08-17T02:26:04.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.047+0000 7f1984c00640 1 -- 172.21.15.146:0/2651817301 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f19800541e0 con 0x7f1988140580 2024-08-17T02:26:04.047 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:04.048 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:03.077372+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 msgr2=0x7f1968067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 0x7f1968067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f197c034000 tx=0x7f197c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 msgr2=0x7f1988069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1980007f20 tx=0x7f1980009860 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 shutdown_connections 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1968065150 0x7f1968067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1988140580 0x7f1988069930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881401b0 0x7f198815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 --2- 172.21.15.146:0/2651817301 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f19880b1270 0x7f19880c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 >> 172.21.15.146:0/2651817301 conn(0x7f19880cb9b0 msgr2=0x7f19880aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 shutdown_connections 2024-08-17T02:26:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.049+0000 7f1990200640 1 -- 172.21.15.146:0/2651817301 wait complete. 2024-08-17T02:26:04.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:04.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.214+0000 7fb78d800640 1 Processor -- start 2024-08-17T02:26:04.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.214+0000 7fb78d800640 1 -- start start 2024-08-17T02:26:04.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb78d800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7881401b0 0x7fb7880caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb78d800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7880b1440 0x7fb7880c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb78d800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880caa80 con 0x7fb788140580 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb78d800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880cb450 con 0x7fb7880b1440 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb78d800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c9e70 con 0x7fb7881401b0 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb787400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7880b1440 0x7fb7880c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb787400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7880b1440 0x7fb7880c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57328/0 (socket says 172.21.15.146:57328) 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb787400640 1 -- 172.21.15.146:0/3486757553 learned_addr learned my addr 172.21.15.146:0/3486757553 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.215+0000 7fb786a00640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7881401b0 0x7fb7880caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.216+0000 7fb787400640 1 -- 172.21.15.146:0/3486757553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7881401b0 msgr2=0x7fb7880caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.216+0000 7fb787400640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7881401b0 0x7fb7880caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.216+0000 7fb787400640 1 -- 172.21.15.146:0/3486757553 >> v1:172.21.15.150:6789/0 conn(0x7fb788140580 legacy=0x7fb7880b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.216+0000 7fb787400640 1 -- 172.21.15.146:0/3486757553 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880ca150 con 0x7fb7880b1440 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb787400640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7880b1440 0x7fb7880c9040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb780009f20 tx=0x7fb780009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa61de2475352ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb786000640 1 -- 172.21.15.146:0/3486757553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780031400 con 0x7fb7880b1440 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb786000640 1 -- 172.21.15.146:0/3486757553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78002d050 con 0x7fb7880b1440 2024-08-17T02:26:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb786000640 1 -- 172.21.15.146:0/3486757553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800317d0 con 0x7fb7880b1440 2024-08-17T02:26:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb78d800640 1 -- 172.21.15.146:0/3486757553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7880b1440 msgr2=0x7fb7880c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.217+0000 7fb78d800640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7880b1440 0x7fb7880c9040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb780009f20 tx=0x7fb780009840 comp rx=0 tx=0).stop 2024-08-17T02:26:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 -- 172.21.15.146:0/3486757553 shutdown_connections 2024-08-17T02:26:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7880b1440 0x7fb7880c9040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 --2- 172.21.15.146:0/3486757553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7881401b0 0x7fb7880caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 -- 172.21.15.146:0/3486757553 >> 172.21.15.146:0/3486757553 conn(0x7fb7880cb9b0 msgr2=0x7fb7880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 -- 172.21.15.146:0/3486757553 shutdown_connections 2024-08-17T02:26:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.218+0000 7fb78d800640 1 -- 172.21.15.146:0/3486757553 wait complete. 2024-08-17T02:26:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.219+0000 7fb78d800640 1 Processor -- start 2024-08-17T02:26:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.219+0000 7fb78d800640 1 -- start start 2024-08-17T02:26:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7880b1440 0x7fb78813cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7881401b0 0x7fb7880a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a68f0 con 0x7fb788140580 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a5ce0 con 0x7fb7881401b0 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb78d800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880a5fc0 con 0x7fb7880b1440 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb787400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb787400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57332/0 (socket says 172.21.15.146:57332) 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb787400640 1 -- 172.21.15.146:0/4115546788 learned_addr learned my addr 172.21.15.146:0/4115546788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb77fe00640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7881401b0 0x7fb7880a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.220+0000 7fb786a00640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7880b1440 0x7fb78813cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 -- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7880b1440 msgr2=0x7fb78813cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7880b1440 0x7fb78813cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 -- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7881401b0 msgr2=0x7fb7880a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7881401b0 0x7fb7880a6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 -- 172.21.15.146:0/4115546788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009ae0 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb787400640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb780009f80 tx=0x7fb780036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780008e50 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78003b410 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78003b7d0 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880a62a0 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.221+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880a5920 con 0x7fb788140580 2024-08-17T02:26:04.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.222+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880a6aa0 con 0x7fb788140580 2024-08-17T02:26:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.223+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb780038050 con 0x7fb788140580 2024-08-17T02:26:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.224+0000 7fb77e000640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 0x7fb764067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.224+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7800a2ff0 con 0x7fb788140580 2024-08-17T02:26:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.224+0000 7fb786a00640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 0x7fb764067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.225+0000 7fb786a00640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 0x7fb764067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb778009d20 tx=0x7fb7780090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.228+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb7800d4e40 con 0x7fb788140580 2024-08-17T02:26:04.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.406+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb788064db0 con 0x7fb788140580 2024-08-17T02:26:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.407+0000 7fb77e000640 1 -- 172.21.15.146:0/4115546788 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fb7880a6aa0 con 0x7fb788140580 2024-08-17T02:26:04.407 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:04.407 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:03.077372+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 msgr2=0x7fb764067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 0x7fb764067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb778009d20 tx=0x7fb7780090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 msgr2=0x7fb7880c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb780009f80 tx=0x7fb780036000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 shutdown_connections 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb764065150 0x7fb764067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb788140580 0x7fb7880c6ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7881401b0 0x7fb7880a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 --2- 172.21.15.146:0/4115546788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb7880b1440 0x7fb78813cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 >> 172.21.15.146:0/4115546788 conn(0x7fb7880cb9b0 msgr2=0x7fb7880c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.409+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 shutdown_connections 2024-08-17T02:26:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.410+0000 7fb78d800640 1 -- 172.21.15.146:0/4115546788 wait complete. 2024-08-17T02:26:04.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:04.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.576+0000 7f7f89800640 1 Processor -- start 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.576+0000 7f7f89800640 1 -- start start 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f89800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7f840caa20 0x7f7f840c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f89800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840cb540 con 0x7f7f84158e20 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f89800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840cf7f0 con 0x7f7f840c3390 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f89800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840caef0 con 0x7f7f840caa20 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f82a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f84158e20 0x7f7f840ca310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54652/0 (socket says 172.21.15.146:54652) 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f82a00640 1 -- 172.21.15.146:0/2655488593 learned_addr learned my addr 172.21.15.146:0/2655488593 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.577+0000 7f7f82000640 1 --2- 172.21.15.146:0/2655488593 >> v2:172.21.15.150:3300/0 conn(0x7f7f840caa20 0x7f7f840c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.578+0000 7f7f81600640 1 -- 172.21.15.146:0/2655488593 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545696509 0 0) 0x7f7f840cb540 con 0x7f7f84158e20 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.578+0000 7f7f81600640 1 -- 172.21.15.146:0/2655488593 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f680034e0 con 0x7f7f84158e20 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.578+0000 7f7f82000640 1 -- 172.21.15.146:0/2655488593 >> v1:172.21.15.150:6789/0 conn(0x7f7f840c3390 legacy=0x7f7f840c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.578+0000 7f7f82000640 1 -- 172.21.15.146:0/2655488593 >> v1:172.21.15.146:6789/0 conn(0x7f7f84158e20 legacy=0x7f7f840ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.578+0000 7f7f82000640 1 -- 172.21.15.146:0/2655488593 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840cb1d0 con 0x7f7f840caa20 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.579+0000 7f7f82000640 1 --2- 172.21.15.146:0/2655488593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840caa20 0x7f7f840c6e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009850 tx=0x7f7f700090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76157b00a0289103 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.579+0000 7f7f81600640 1 -- 172.21.15.146:0/2655488593 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7002ae20 con 0x7f7f840caa20 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.579+0000 7f7f81600640 1 -- 172.21.15.146:0/2655488593 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70032440 con 0x7f7f840caa20 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.579+0000 7f7f81600640 1 -- 172.21.15.146:0/2655488593 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700327c0 con 0x7f7f840caa20 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 -- 172.21.15.146:0/2655488593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840caa20 msgr2=0x7f7f840c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 --2- 172.21.15.146:0/2655488593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840caa20 0x7f7f840c6e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009850 tx=0x7f7f700090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 -- 172.21.15.146:0/2655488593 shutdown_connections 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 --2- 172.21.15.146:0/2655488593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840caa20 0x7f7f840c6e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 -- 172.21.15.146:0/2655488593 >> 172.21.15.146:0/2655488593 conn(0x7f7f840cfd70 msgr2=0x7f7f840d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 -- 172.21.15.146:0/2655488593 shutdown_connections 2024-08-17T02:26:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.580+0000 7f7f89800640 1 -- 172.21.15.146:0/2655488593 wait complete. 2024-08-17T02:26:04.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.581+0000 7f7f89800640 1 Processor -- start 2024-08-17T02:26:04.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.581+0000 7f7f89800640 1 -- start start 2024-08-17T02:26:04.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840c3390 0x7f7f8414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f840caa20 0x7f7f840c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84155670 con 0x7f7f84158e20 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841558c0 con 0x7f7f840c3390 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f89800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84155ba0 con 0x7f7f840caa20 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f83400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f83400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57338/0 (socket says 172.21.15.146:57338) 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f83400640 1 -- 172.21.15.146:0/736473587 learned_addr learned my addr 172.21.15.146:0/736473587 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.582+0000 7f7f82a00640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840c3390 0x7f7f8414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f82000640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f840caa20 0x7f7f840c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 -- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f840caa20 msgr2=0x7f7f840c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f840caa20 0x7f7f840c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 -- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840c3390 msgr2=0x7f7f8414e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840c3390 0x7f7f8414e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 -- 172.21.15.146:0/736473587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009390 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f83400640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c830 tx=0x7f7f7c001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00ce20 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00a850 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f84155e80 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00ac10 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.583+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84156680 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.584+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f84071050 con 0x7f7f84158e20 2024-08-17T02:26:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.585+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7f7c012630 con 0x7f7f84158e20 2024-08-17T02:26:04.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.586+0000 7f7f7a000640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 0x7f7f64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.586+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f7c082640 con 0x7f7f84158e20 2024-08-17T02:26:04.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.587+0000 7f7f82a00640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 0x7f7f64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.587+0000 7f7f82a00640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 0x7f7f64067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005840 tx=0x7f7f74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.590+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7f7c050710 con 0x7f7f84158e20 2024-08-17T02:26:04.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:04.809+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f84067260 con 0x7f7f84158e20 2024-08-17T02:26:05.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.696+0000 7f7f7a000640 1 -- 172.21.15.146:0/736473587 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f7c053d30 con 0x7f7f84158e20 2024-08-17T02:26:05.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 msgr2=0x7f7f64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 0x7f7f64067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f74005840 tx=0x7f7f74009040 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 msgr2=0x7f7f840c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c830 tx=0x7f7f7c001660 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 shutdown_connections 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7f64065150 0x7f7f64067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f84158e20 0x7f7f840c6080 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f840caa20 0x7f7f840c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 --2- 172.21.15.146:0/736473587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f840c3390 0x7f7f8414e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 >> 172.21.15.146:0/736473587 conn(0x7f7f840cfd70 msgr2=0x7f7f840c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.698+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 shutdown_connections 2024-08-17T02:26:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.699+0000 7f7f89800640 1 -- 172.21.15.146:0/736473587 wait complete. 2024-08-17T02:26:05.716 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.872+0000 7f54d8c00640 1 Processor -- start 2024-08-17T02:26:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.872+0000 7f54d8c00640 1 -- start start 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d8c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54d40af0f0 0x7f54d40abc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d8c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 0x7f54d40ac160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d8c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40ab790 con 0x7f54d40ae540 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d8c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d40aab80 con 0x7f54d40af0f0 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d8c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40aae60 con 0x7f54d40af520 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d3400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f54d40ae540 0x7f54d40ae910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55778/0 (socket says 172.21.15.146:55778) 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54d3400640 1 -- 172.21.15.146:0/4112207472 learned_addr learned my addr 172.21.15.146:0/4112207472 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.873+0000 7f54caa00640 1 --2- 172.21.15.146:0/4112207472 >> v2:172.21.15.146:3300/0 conn(0x7f54d40af0f0 0x7f54d40abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54d3e00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 0x7f54d40ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54d2a00640 1 -- 172.21.15.146:0/4112207472 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050721938 0 0) 0x7f54d40ab790 con 0x7f54d40ae540 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54d2a00640 1 -- 172.21.15.146:0/4112207472 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b80034e0 con 0x7f54d40ae540 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54caa00640 1 -- 172.21.15.146:0/4112207472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 msgr2=0x7f54d40ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54caa00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 0x7f54d40ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54caa00640 1 -- 172.21.15.146:0/4112207472 >> v1:172.21.15.146:6789/0 conn(0x7f54d40ae540 legacy=0x7f54d40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54caa00640 1 -- 172.21.15.146:0/4112207472 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40ab140 con 0x7f54d40af0f0 2024-08-17T02:26:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.874+0000 7f54d3e00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 0x7f54d40ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:05.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.875+0000 7f54caa00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40af0f0 0x7f54d40abc20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009850 tx=0x7f54bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe2c4b10237886c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.875+0000 7f54d2a00640 1 -- 172.21.15.146:0/4112207472 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc02ad90 con 0x7f54d40af0f0 2024-08-17T02:26:05.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.875+0000 7f54d2a00640 1 -- 172.21.15.146:0/4112207472 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc032440 con 0x7f54d40af0f0 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.875+0000 7f54d2a00640 1 -- 172.21.15.146:0/4112207472 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc032820 con 0x7f54d40af0f0 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 -- 172.21.15.146:0/4112207472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40af0f0 msgr2=0x7f54d40abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40af0f0 0x7f54d40abc20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009850 tx=0x7f54bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 -- 172.21.15.146:0/4112207472 shutdown_connections 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40af0f0 0x7f54d40abc20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 --2- 172.21.15.146:0/4112207472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af520 0x7f54d40ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 -- 172.21.15.146:0/4112207472 >> 172.21.15.146:0/4112207472 conn(0x7f54d4096a70 msgr2=0x7f54d4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 -- 172.21.15.146:0/4112207472 shutdown_connections 2024-08-17T02:26:05.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.876+0000 7f54d8c00640 1 -- 172.21.15.146:0/4112207472 wait complete. 2024-08-17T02:26:05.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.877+0000 7f54d8c00640 1 Processor -- start 2024-08-17T02:26:05.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.877+0000 7f54d8c00640 1 -- start start 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af0f0 0x7f54d4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d40af520 0x7f54d40ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40cb080 con 0x7f54d40ae540 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4144270 con 0x7f54d40af520 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d8c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40caac0 con 0x7f54d40af0f0 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.878+0000 7f54d3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40070/0 (socket says 172.21.15.146:40070) 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 -- 172.21.15.146:0/1125594593 learned_addr learned my addr 172.21.15.146:0/1125594593 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54caa00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af0f0 0x7f54d4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3e00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d40af520 0x7f54d40ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 -- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af0f0 msgr2=0x7f54d4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af0f0 0x7f54d4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 -- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d40af520 msgr2=0x7f54d40ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d40af520 0x7f54d40ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 -- 172.21.15.146:0/1125594593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc009390 con 0x7f54d40ae540 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d3400640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c5e0 tx=0x7f54c4007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4005b70 con 0x7f54d40ae540 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4005cf0 con 0x7f54d40ae540 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4005ea0 con 0x7f54d40ae540 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.879+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d40cada0 con 0x7f54d40ae540 2024-08-17T02:26:05.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.880+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d40cbc80 con 0x7f54d40ae540 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.881+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d40cbe70 con 0x7f54d40ae540 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.881+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f54c401b400 con 0x7f54d40ae540 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.882+0000 7f54cb400640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 0x7f54b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.882+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54c4081df0 con 0x7f54d40ae540 2024-08-17T02:26:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.882+0000 7f54caa00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 0x7f54b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.883+0000 7f54caa00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 0x7f54b0067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54bc034000 tx=0x7f54bc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:05.886+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54c404ff40 con 0x7f54d40ae540 2024-08-17T02:26:06.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.095+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f54d4071050 con 0x7f54d40ae540 2024-08-17T02:26:06.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.703+0000 7f54cb400640 1 -- 172.21.15.146:0/1125594593 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f54c4053560 con 0x7f54d40ae540 2024-08-17T02:26:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 msgr2=0x7f54b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 0x7f54b0067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54bc034000 tx=0x7f54bc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 msgr2=0x7f54d41444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c5e0 tx=0x7f54c4007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 shutdown_connections 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f54b0065150 0x7f54b0067600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54d40af520 0x7f54d40ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54d40af0f0 0x7f54d4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 --2- 172.21.15.146:0/1125594593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d40ae540 0x7f54d41444f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 >> 172.21.15.146:0/1125594593 conn(0x7f54d4096a70 msgr2=0x7f54d4069040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 shutdown_connections 2024-08-17T02:26:06.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.705+0000 7f54d8c00640 1 -- 172.21.15.146:0/1125594593 wait complete. 2024-08-17T02:26:06.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.869+0000 7fb168600640 1 Processor -- start 2024-08-17T02:26:06.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.869+0000 7fb168600640 1 -- start start 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb168600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1600aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb168600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600afc10 con 0x7fb160155180 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb168600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600af000 con 0x7fb16006e080 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb168600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600af2e0 con 0x7fb160155550 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb165c00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb160155180 0x7fb1600ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55788/0 (socket says 172.21.15.146:55788) 2024-08-17T02:26:06.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb165c00640 1 -- 172.21.15.146:0/2735306691 learned_addr learned my addr 172.21.15.146:0/2735306691 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb165200640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1600aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922479328 0 0) 0x7fb1600afc10 con 0x7fb160155180 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.871+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1480056f0 con 0x7fb160155180 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140558122 0 0) 0x7fb1480056f0 con 0x7fb160155180 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 msgr2=0x7fb1600aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1600aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 >> v1:172.21.15.150:6789/0 conn(0x7fb16006e080 legacy=0x7fb1600c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600af5c0 con 0x7fb160155180 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7fb154001470 con 0x7fb160155180 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 >> v1:172.21.15.146:6789/0 conn(0x7fb160155180 legacy=0x7fb1600ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148005c10 0x7fb148006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148006990 0x7fb148006e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1480073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600af2e0 con 0x7fb148006990 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800dd70 con 0x7fb148005c10 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14800df30 con 0x7fb160155550 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148006990 0x7fb148006e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165c00640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148005c10 0x7fb148006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb166600640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1480073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 -- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 msgr2=0x7fb1480073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160155550 0x7fb1480073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 -- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148005c10 msgr2=0x7fb148006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148005c10 0x7fb148006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.872+0000 7fb165200640 1 -- 172.21.15.146:0/2735306691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1480056f0 con 0x7fb148006990 2024-08-17T02:26:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.873+0000 7fb165200640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148006990 0x7fb148006e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009b70 tx=0x7fb14c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da27db9f74eb8ade server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c031400 con 0x7fb148006990 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c02d050 con 0x7fb148006990 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb15fe00640 1 -- 172.21.15.146:0/2735306691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c031790 con 0x7fb148006990 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 -- 172.21.15.146:0/2735306691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148006990 msgr2=0x7fb148006e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 --2- 172.21.15.146:0/2735306691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb148006990 0x7fb148006e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009b70 tx=0x7fb14c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb166600640 1 -- 172.21.15.146:0/2735306691 reap_dead start 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 -- 172.21.15.146:0/2735306691 shutdown_connections 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 -- 172.21.15.146:0/2735306691 >> 172.21.15.146:0/2735306691 conn(0x7fb1600cb9b0 msgr2=0x7fb1600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 -- 172.21.15.146:0/2735306691 shutdown_connections 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.874+0000 7fb168600640 1 -- 172.21.15.146:0/2735306691 wait complete. 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.876+0000 7fb168600640 1 Processor -- start 2024-08-17T02:26:06.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.876+0000 7fb168600640 1 -- start start 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb160156f30 0x7fb1600c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 0x7fb160154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601547b0 con 0x7fb160156f30 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601566c0 con 0x7fb148006990 2024-08-17T02:26:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb168600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160155ab0 con 0x7fb160153e00 2024-08-17T02:26:06.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb165c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb165200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb160156f30 0x7fb1600c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb166600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 0x7fb160154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb165c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39690/0 (socket says 172.21.15.146:39690) 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.877+0000 7fb165c00640 1 -- 172.21.15.146:0/571333610 learned_addr learned my addr 172.21.15.146:0/571333610 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 -- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 msgr2=0x7fb160151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 -- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb160156f30 msgr2=0x7fb1600c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb160156f30 0x7fb1600c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 -- 172.21.15.146:0/571333610 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160155d90 con 0x7fb160153e00 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb165c00640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb166600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 0x7fb160154270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb160068650 tx=0x7fb158007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800eda0 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158006b10 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb160156070 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.878+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158014480 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.879+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160151e60 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.880+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160064db0 con 0x7fb160153e00 2024-08-17T02:26:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.880+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb158007030 con 0x7fb160153e00 2024-08-17T02:26:06.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.881+0000 7fb15cc00640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.881+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1580813c0 con 0x7fb160153e00 2024-08-17T02:26:06.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.881+0000 7fb165c00640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.882+0000 7fb165c00640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 0x7fb140067630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1540015a0 tx=0x7fb154001d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:06.887+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb15804f3e0 con 0x7fb160153e00 2024-08-17T02:26:07.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.094+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb160156800 con 0x7fb160153e00 2024-08-17T02:26:07.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.095+0000 7fb15cc00640 1 -- 172.21.15.146:0/571333610 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fb158052a00 con 0x7fb160153e00 2024-08-17T02:26:07.095 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:07.095 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:07.096 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 msgr2=0x7fb140067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 0x7fb140067630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1540015a0 tx=0x7fb154001d80 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 msgr2=0x7fb160154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 0x7fb160154270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb160068650 tx=0x7fb158007f90 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 shutdown_connections 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb160156f30 0x7fb1600c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb160153e00 0x7fb160154270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 --2- 172.21.15.146:0/571333610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb148006990 0x7fb160151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 >> 172.21.15.146:0/571333610 conn(0x7fb1600cb9b0 msgr2=0x7fb160152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 shutdown_connections 2024-08-17T02:26:07.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.097+0000 7fb168600640 1 -- 172.21.15.146:0/571333610 wait complete. 2024-08-17T02:26:07.112 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.261+0000 7fe56ae00640 1 Processor -- start 2024-08-17T02:26:07.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.261+0000 7fe56ae00640 1 -- start start 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe56ae00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5641401b0 0x7fe5640caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe56ae00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5640b1440 0x7fe5640c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe56ae00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640caa80 con 0x7fe564140580 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe56ae00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640cb450 con 0x7fe5641401b0 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe56ae00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640c9e70 con 0x7fe5640b1440 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5641401b0 0x7fe5640caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5641401b0 0x7fe5640caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40076/0 (socket says 172.21.15.146:40076) 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 -- 172.21.15.146:0/3737104345 learned_addr learned my addr 172.21.15.146:0/3737104345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:07.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe568e00640 1 --2- 172.21.15.146:0/3737104345 >> v2:172.21.15.150:3300/0 conn(0x7fe5640b1440 0x7fe5640c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 -- 172.21.15.146:0/3737104345 >> v2:172.21.15.150:3300/0 conn(0x7fe5640b1440 msgr2=0x7fe5640c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 --2- 172.21.15.146:0/3737104345 >> v2:172.21.15.150:3300/0 conn(0x7fe5640b1440 0x7fe5640c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 -- 172.21.15.146:0/3737104345 >> v1:172.21.15.146:6789/0 conn(0x7fe564140580 legacy=0x7fe5640b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563e00640 1 -- 172.21.15.146:0/3737104345 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640ca150 con 0x7fe5641401b0 2024-08-17T02:26:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.263+0000 7fe563400640 1 -- 172.21.15.146:0/3737104345 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948768914 0 0) 0x7fe5640caa80 con 0x7fe564140580 2024-08-17T02:26:07.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.264+0000 7fe563e00640 1 --2- 172.21.15.146:0/3737104345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5641401b0 0x7fe5640caf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5640ca9f0 tx=0x7fe5540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd36365baf803dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe563400640 1 -- 172.21.15.146:0/3737104345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55402adf0 con 0x7fe5641401b0 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe563400640 1 -- 172.21.15.146:0/3737104345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554032440 con 0x7fe5641401b0 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe563400640 1 -- 172.21.15.146:0/3737104345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540327e0 con 0x7fe5641401b0 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 -- 172.21.15.146:0/3737104345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5641401b0 msgr2=0x7fe5640caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 --2- 172.21.15.146:0/3737104345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5641401b0 0x7fe5640caf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5640ca9f0 tx=0x7fe5540091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 -- 172.21.15.146:0/3737104345 shutdown_connections 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 --2- 172.21.15.146:0/3737104345 >> v2:172.21.15.150:3300/0 conn(0x7fe5640b1440 0x7fe5640c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 --2- 172.21.15.146:0/3737104345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5641401b0 0x7fe5640caf10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 -- 172.21.15.146:0/3737104345 >> 172.21.15.146:0/3737104345 conn(0x7fe5640cb9b0 msgr2=0x7fe5640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 -- 172.21.15.146:0/3737104345 shutdown_connections 2024-08-17T02:26:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.265+0000 7fe56ae00640 1 -- 172.21.15.146:0/3737104345 wait complete. 2024-08-17T02:26:07.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.267+0000 7fe56ae00640 1 Processor -- start 2024-08-17T02:26:07.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.267+0000 7fe56ae00640 1 -- start start 2024-08-17T02:26:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.267+0000 7fe56ae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe56ae00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 0x7fe5640a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe56ae00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe564140580 0x7fe5640a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe56ae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c09a0 con 0x7fe5640b1440 2024-08-17T02:26:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe56ae00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c0f60 con 0x7fe5641401b0 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe56ae00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640ab360 con 0x7fe564140580 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40078/0 (socket says 172.21.15.146:40078) 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 -- 172.21.15.146:0/791401556 learned_addr learned my addr 172.21.15.146:0/791401556 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe568e00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe564140580 0x7fe5640a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe55b400640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 0x7fe5640a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 -- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe564140580 msgr2=0x7fe5640a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe564140580 0x7fe5640a8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 -- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 msgr2=0x7fe5640a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 0x7fe5640a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 -- 172.21.15.146:0/791401556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554009450 con 0x7fe5640b1440 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe55b400640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 0x7fe5640a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.268+0000 7fe563e00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe554009910 tx=0x7fe554032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.269+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540317e0 con 0x7fe5640b1440 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.269+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554031940 con 0x7fe5640b1440 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.269+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554031d00 con 0x7fe5640b1440 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.269+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5640ab640 con 0x7fe5640b1440 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.269+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5641355f0 con 0x7fe5640b1440 2024-08-17T02:26:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.270+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe564064db0 con 0x7fe5640b1440 2024-08-17T02:26:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.271+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe55403c610 con 0x7fe5640b1440 2024-08-17T02:26:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.271+0000 7fe55be00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 0x7fe540067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.272+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5540a2960 con 0x7fe5640b1440 2024-08-17T02:26:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.272+0000 7fe55b400640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 0x7fe540067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.272+0000 7fe55b400640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 0x7fe540067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0011e0 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.276+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe554070980 con 0x7fe5640b1440 2024-08-17T02:26:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.449+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe564157180 con 0x7fe5640b1440 2024-08-17T02:26:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.450+0000 7fe55be00640 1 -- 172.21.15.146:0/791401556 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe554031e60 con 0x7fe5640b1440 2024-08-17T02:26:07.451 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:07.451 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.452+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 msgr2=0x7fe540067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.452+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 0x7fe540067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0011e0 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.452+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 msgr2=0x7fe5640abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.452+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe554009910 tx=0x7fe554032000 comp rx=0 tx=0).stop 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 shutdown_connections 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe540065180 0x7fe540067630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe564140580 0x7fe5640a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5641401b0 0x7fe5640a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 --2- 172.21.15.146:0/791401556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b1440 0x7fe5640abbc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 >> 172.21.15.146:0/791401556 conn(0x7fe5640cb9b0 msgr2=0x7fe56406df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 shutdown_connections 2024-08-17T02:26:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.453+0000 7fe56ae00640 1 -- 172.21.15.146:0/791401556 wait complete. 2024-08-17T02:26:07.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:07.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:07.469 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-08-17T02:26:07.470+0000 7f6c15600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:07.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.617+0000 7f4afa800640 1 Processor -- start 2024-08-17T02:26:07.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.617+0000 7f4afa800640 1 -- start start 2024-08-17T02:26:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4afa800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 0x7f4af406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4afa800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 0x7f4af4066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4afa800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af406b9d0 con 0x7f4af415c600 2024-08-17T02:26:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4afa800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af406ebf0 con 0x7f4af40aa8f0 2024-08-17T02:26:07.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4afa800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40aad80 con 0x7f4af415c230 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4af2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4af415c600 0x7f4af406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55810/0 (socket says 172.21.15.146:55810) 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.618+0000 7f4af2a00640 1 -- 172.21.15.146:0/3963373799 learned_addr learned my addr 172.21.15.146:0/3963373799 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3400640 1 --2- 172.21.15.146:0/3963373799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 0x7f4af406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3e00640 1 --2- 172.21.15.146:0/3963373799 >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 0x7f4af4066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967027548 0 0) 0x7f4af406b9d0 con 0x7f4af415c600 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad80034e0 con 0x7f4af415c600 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3400640 1 -- 172.21.15.146:0/3963373799 >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 msgr2=0x7f4af4066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3400640 1 --2- 172.21.15.146:0/3963373799 >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 0x7f4af4066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3400640 1 -- 172.21.15.146:0/3963373799 >> v1:172.21.15.146:6789/0 conn(0x7f4af415c600 legacy=0x7f4af406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121635046 0 0) 0x7f4ad80034e0 con 0x7f4af415c600 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3400640 1 -- 172.21.15.146:0/3963373799 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40ab060 con 0x7f4af415c230 2024-08-17T02:26:07.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.619+0000 7f4af3e00640 1 --2- 172.21.15.146:0/3963373799 >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 0x7f4af4066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.620+0000 7f4af3400640 1 --2- 172.21.15.146:0/3963373799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 0x7f4af406be60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009850 tx=0x7f4ae40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04e5a922f0239f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0001470 con 0x7f4af415c230 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae402aa50 con 0x7f4af415c230 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4af2000640 1 -- 172.21.15.146:0/3963373799 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae402adf0 con 0x7f4af415c230 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 -- 172.21.15.146:0/3963373799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 msgr2=0x7f4af406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 --2- 172.21.15.146:0/3963373799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 0x7f4af406be60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009850 tx=0x7f4ae40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 -- 172.21.15.146:0/3963373799 shutdown_connections 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 --2- 172.21.15.146:0/3963373799 >> v2:172.21.15.150:3300/0 conn(0x7f4af40aa8f0 0x7f4af4066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 --2- 172.21.15.146:0/3963373799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c230 0x7f4af406be60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 -- 172.21.15.146:0/3963373799 >> 172.21.15.146:0/3963373799 conn(0x7f4af406d8f0 msgr2=0x7f4af406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 -- 172.21.15.146:0/3963373799 shutdown_connections 2024-08-17T02:26:07.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.621+0000 7f4afa800640 1 -- 172.21.15.146:0/3963373799 wait complete. 2024-08-17T02:26:07.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.623+0000 7f4afa800640 1 Processor -- start 2024-08-17T02:26:07.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.623+0000 7f4afa800640 1 -- start start 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af415c230 0x7f4af414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c600 0x7f4af40cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40caab0 con 0x7f4af40aa8f0 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40cad90 con 0x7f4af415c230 2024-08-17T02:26:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4afa800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40cb070 con 0x7f4af415c600 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40092/0 (socket says 172.21.15.146:40092) 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 -- 172.21.15.146:0/3141481157 learned_addr learned my addr 172.21.15.146:0/3141481157 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 -- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c600 msgr2=0x7f4af40cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c600 0x7f4af40cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 -- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af415c230 msgr2=0x7f4af414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af415c230 0x7f4af414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.624+0000 7f4af3400640 1 -- 172.21.15.146:0/3141481157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec009a20 con 0x7f4af40aa8f0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4af3400640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009850 tx=0x7f4ae4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4032e60 con 0x7f4af40aa8f0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae403d420 con 0x7f4af40aa8f0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae403d7e0 con 0x7f4af40aa8f0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae4009390 con 0x7f4af40aa8f0 2024-08-17T02:26:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.625+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40cb630 con 0x7f4af40aa8f0 2024-08-17T02:26:07.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.626+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af4064db0 con 0x7f4af40aa8f0 2024-08-17T02:26:07.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.627+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ae4039040 con 0x7f4af40aa8f0 2024-08-17T02:26:07.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.628+0000 7f4aeaa00640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 0x7f4ad4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.628+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ae40a1a60 con 0x7f4af40aa8f0 2024-08-17T02:26:07.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.628+0000 7f4af2a00640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 0x7f4ad4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.629+0000 7f4af2a00640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 0x7f4ad4067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00011e0 tx=0x7f4ae0001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.632+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ae406fa80 con 0x7f4af40aa8f0 2024-08-17T02:26:07.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.805+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4af40b03d0 con 0x7f4ad4065150 2024-08-17T02:26:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.813+0000 7f4aeaa00640 1 -- 172.21.15.146:0/3141481157 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264661 (secure 0 0 0) 0x7f4af40b03d0 con 0x7f4ad4065150 2024-08-17T02:26:07.817 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.817+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 msgr2=0x7f4ad4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.817+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 0x7f4ad4067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00011e0 tx=0x7f4ae0001340 comp rx=0 tx=0).stop 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.817+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 msgr2=0x7f4af413b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.817+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009850 tx=0x7f4ae4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.817+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 shutdown_connections 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4ad4065150 0x7f4ad4067600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af415c600 0x7f4af40cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af415c230 0x7f4af414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 --2- 172.21.15.146:0/3141481157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4af40aa8f0 0x7f4af413b000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 >> 172.21.15.146:0/3141481157 conn(0x7f4af406d8f0 msgr2=0x7f4af40b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 shutdown_connections 2024-08-17T02:26:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:07.818+0000 7f4afa800640 1 -- 172.21.15.146:0/3141481157 wait complete. 2024-08-17T02:26:07.833 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:26:06.321064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381648,"kb_used_data":2764,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593072,"statfs":{"total":773094113280,"available":770655305728,"internally_reserved":0,"allocated":2830336,"data_stored":1719204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.663149"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710211+0000","last_change":"2024-08-17T02:26:03.706448+0000","last_active":"2024-08-17T02:26:03.710211+0000","last_peered":"2024-08-17T02:26:03.710211+0000","last_clean":"2024-08-17T02:26:03.710211+0000","last_became_active":"2024-08-17T02:26:03.691979+0000","last_became_peered":"2024-08-17T02:26:03.691979+0000","last_unstale":"2024-08-17T02:26:03.710211+0000","last_undegraded":"2024-08-17T02:26:03.710211+0000","last_fullsized":"2024-08-17T02:26:03.710211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683666+0000","last_change":"2024-08-17T02:26:03.683666+0000","last_active":"2024-08-17T02:26:03.683666+0000","last_peered":"2024-08-17T02:26:03.683666+0000","last_clean":"2024-08-17T02:26:03.683666+0000","last_became_active":"2024-08-17T02:26:03.683431+0000","last_became_peered":"2024-08-17T02:26:03.683431+0000","last_unstale":"2024-08-17T02:26:03.683666+0000","last_undegraded":"2024-08-17T02:26:03.683666+0000","last_fullsized":"2024-08-17T02:26:03.683666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686845+0000","last_change":"2024-08-17T02:26:03.684515+0000","last_active":"2024-08-17T02:26:03.686845+0000","last_peered":"2024-08-17T02:26:03.686845+0000","last_clean":"2024-08-17T02:26:03.686845+0000","last_became_active":"2024-08-17T02:26:03.684225+0000","last_became_peered":"2024-08-17T02:26:03.684225+0000","last_unstale":"2024-08-17T02:26:03.686845+0000","last_undegraded":"2024-08-17T02:26:03.686845+0000","last_fullsized":"2024-08-17T02:26:03.686845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:48.325629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695442+0000","last_change":"2024-08-17T02:26:03.695442+0000","last_active":"2024-08-17T02:26:03.695442+0000","last_peered":"2024-08-17T02:26:03.695442+0000","last_clean":"2024-08-17T02:26:03.695442+0000","last_became_active":"2024-08-17T02:26:03.694771+0000","last_became_peered":"2024-08-17T02:26:03.694771+0000","last_unstale":"2024-08-17T02:26:03.695442+0000","last_undegraded":"2024-08-17T02:26:03.695442+0000","last_fullsized":"2024-08-17T02:26:03.695442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706316+0000","last_change":"2024-08-17T02:26:03.691208+0000","last_active":"2024-08-17T02:26:03.706316+0000","last_peered":"2024-08-17T02:26:03.706316+0000","last_clean":"2024-08-17T02:26:03.706316+0000","last_became_active":"2024-08-17T02:26:03.690708+0000","last_became_peered":"2024-08-17T02:26:03.690708+0000","last_unstale":"2024-08-17T02:26:03.706316+0000","last_undegraded":"2024-08-17T02:26:03.706316+0000","last_fullsized":"2024-08-17T02:26:03.706316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696680+0000","last_change":"2024-08-17T02:26:03.696680+0000","last_active":"2024-08-17T02:26:03.696680+0000","last_peered":"2024-08-17T02:26:03.696680+0000","last_clean":"2024-08-17T02:26:03.696680+0000","last_became_active":"2024-08-17T02:26:03.696347+0000","last_became_peered":"2024-08-17T02:26:03.696347+0000","last_unstale":"2024-08-17T02:26:03.696680+0000","last_undegraded":"2024-08-17T02:26:03.696680+0000","last_fullsized":"2024-08-17T02:26:03.696680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705465+0000","last_change":"2024-08-17T02:26:03.690098+0000","last_active":"2024-08-17T02:26:03.705465+0000","last_peered":"2024-08-17T02:26:03.705465+0000","last_clean":"2024-08-17T02:26:03.705465+0000","last_became_active":"2024-08-17T02:26:03.688253+0000","last_became_peered":"2024-08-17T02:26:03.688253+0000","last_unstale":"2024-08-17T02:26:03.705465+0000","last_undegraded":"2024-08-17T02:26:03.705465+0000","last_fullsized":"2024-08-17T02:26:03.705465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707688+0000","last_change":"2024-08-17T02:26:03.704945+0000","last_active":"2024-08-17T02:26:03.707688+0000","last_peered":"2024-08-17T02:26:03.707688+0000","last_clean":"2024-08-17T02:26:03.707688+0000","last_became_active":"2024-08-17T02:26:03.704138+0000","last_became_peered":"2024-08-17T02:26:03.704138+0000","last_unstale":"2024-08-17T02:26:03.707688+0000","last_undegraded":"2024-08-17T02:26:03.707688+0000","last_fullsized":"2024-08-17T02:26:03.707688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710295+0000","last_change":"2024-08-17T02:26:03.707594+0000","last_active":"2024-08-17T02:26:03.710295+0000","last_peered":"2024-08-17T02:26:03.710295+0000","last_clean":"2024-08-17T02:26:03.710295+0000","last_became_active":"2024-08-17T02:26:03.707040+0000","last_became_peered":"2024-08-17T02:26:03.707040+0000","last_unstale":"2024-08-17T02:26:03.710295+0000","last_undegraded":"2024-08-17T02:26:03.710295+0000","last_fullsized":"2024-08-17T02:26:03.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.711882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699269+0000","last_change":"2024-08-17T02:26:03.699269+0000","last_active":"2024-08-17T02:26:03.699269+0000","last_peered":"2024-08-17T02:26:03.699269+0000","last_clean":"2024-08-17T02:26:03.699269+0000","last_became_active":"2024-08-17T02:26:03.698978+0000","last_became_peered":"2024-08-17T02:26:03.698978+0000","last_unstale":"2024-08-17T02:26:03.699269+0000","last_undegraded":"2024-08-17T02:26:03.699269+0000","last_fullsized":"2024-08-17T02:26:03.699269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699531+0000","last_change":"2024-08-17T02:26:03.699531+0000","last_active":"2024-08-17T02:26:03.699531+0000","last_peered":"2024-08-17T02:26:03.699531+0000","last_clean":"2024-08-17T02:26:03.699531+0000","last_became_active":"2024-08-17T02:26:03.699231+0000","last_became_peered":"2024-08-17T02:26:03.699231+0000","last_unstale":"2024-08-17T02:26:03.699531+0000","last_undegraded":"2024-08-17T02:26:03.699531+0000","last_fullsized":"2024-08-17T02:26:03.699531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699887+0000","last_change":"2024-08-17T02:26:03.699887+0000","last_active":"2024-08-17T02:26:03.699887+0000","last_peered":"2024-08-17T02:26:03.699887+0000","last_clean":"2024-08-17T02:26:03.699887+0000","last_became_active":"2024-08-17T02:26:03.699594+0000","last_became_peered":"2024-08-17T02:26:03.699594+0000","last_unstale":"2024-08-17T02:26:03.699887+0000","last_undegraded":"2024-08-17T02:26:03.699887+0000","last_fullsized":"2024-08-17T02:26:03.699887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:07.573229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708999+0000","last_change":"2024-08-17T02:26:03.701254+0000","last_active":"2024-08-17T02:26:03.708999+0000","last_peered":"2024-08-17T02:26:03.708999+0000","last_clean":"2024-08-17T02:26:03.708999+0000","last_became_active":"2024-08-17T02:26:03.700989+0000","last_became_peered":"2024-08-17T02:26:03.700989+0000","last_unstale":"2024-08-17T02:26:03.708999+0000","last_undegraded":"2024-08-17T02:26:03.708999+0000","last_fullsized":"2024-08-17T02:26:03.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683122+0000","last_change":"2024-08-17T02:26:03.680779+0000","last_active":"2024-08-17T02:26:03.683122+0000","last_peered":"2024-08-17T02:26:03.683122+0000","last_clean":"2024-08-17T02:26:03.683122+0000","last_became_active":"2024-08-17T02:26:03.678795+0000","last_became_peered":"2024-08-17T02:26:03.678795+0000","last_unstale":"2024-08-17T02:26:03.683122+0000","last_undegraded":"2024-08-17T02:26:03.683122+0000","last_fullsized":"2024-08-17T02:26:03.683122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700633+0000","last_change":"2024-08-17T02:26:03.700633+0000","last_active":"2024-08-17T02:26:03.700633+0000","last_peered":"2024-08-17T02:26:03.700633+0000","last_clean":"2024-08-17T02:26:03.700633+0000","last_became_active":"2024-08-17T02:26:03.700302+0000","last_became_peered":"2024-08-17T02:26:03.700302+0000","last_unstale":"2024-08-17T02:26:03.700633+0000","last_undegraded":"2024-08-17T02:26:03.700633+0000","last_fullsized":"2024-08-17T02:26:03.700633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696556+0000","last_change":"2024-08-17T02:26:03.696556+0000","last_active":"2024-08-17T02:26:03.696556+0000","last_peered":"2024-08-17T02:26:03.696556+0000","last_clean":"2024-08-17T02:26:03.696556+0000","last_became_active":"2024-08-17T02:26:03.696283+0000","last_became_peered":"2024-08-17T02:26:03.696283+0000","last_unstale":"2024-08-17T02:26:03.696556+0000","last_undegraded":"2024-08-17T02:26:03.696556+0000","last_fullsized":"2024-08-17T02:26:03.696556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711711+0000","last_change":"2024-08-17T02:26:03.711711+0000","last_active":"2024-08-17T02:26:03.711711+0000","last_peered":"2024-08-17T02:26:03.711711+0000","last_clean":"2024-08-17T02:26:03.711711+0000","last_became_active":"2024-08-17T02:26:03.711488+0000","last_became_peered":"2024-08-17T02:26:03.711488+0000","last_unstale":"2024-08-17T02:26:03.711711+0000","last_undegraded":"2024-08-17T02:26:03.711711+0000","last_fullsized":"2024-08-17T02:26:03.711711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697674+0000","last_change":"2024-08-17T02:26:03.697674+0000","last_active":"2024-08-17T02:26:03.697674+0000","last_peered":"2024-08-17T02:26:03.697674+0000","last_clean":"2024-08-17T02:26:03.697674+0000","last_became_active":"2024-08-17T02:26:03.694701+0000","last_became_peered":"2024-08-17T02:26:03.694701+0000","last_unstale":"2024-08-17T02:26:03.697674+0000","last_undegraded":"2024-08-17T02:26:03.697674+0000","last_fullsized":"2024-08-17T02:26:03.697674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708484+0000","last_change":"2024-08-17T02:26:03.700361+0000","last_active":"2024-08-17T02:26:03.708484+0000","last_peered":"2024-08-17T02:26:03.708484+0000","last_clean":"2024-08-17T02:26:03.708484+0000","last_became_active":"2024-08-17T02:26:03.691498+0000","last_became_peered":"2024-08-17T02:26:03.691498+0000","last_unstale":"2024-08-17T02:26:03.708484+0000","last_undegraded":"2024-08-17T02:26:03.708484+0000","last_fullsized":"2024-08-17T02:26:03.708484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.703171+0000","last_change":"2024-08-17T02:26:03.703171+0000","last_active":"2024-08-17T02:26:03.703171+0000","last_peered":"2024-08-17T02:26:03.703171+0000","last_clean":"2024-08-17T02:26:03.703171+0000","last_became_active":"2024-08-17T02:26:03.701780+0000","last_became_peered":"2024-08-17T02:26:03.701780+0000","last_unstale":"2024-08-17T02:26:03.703171+0000","last_undegraded":"2024-08-17T02:26:03.703171+0000","last_fullsized":"2024-08-17T02:26:03.703171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.689568+0000","last_change":"2024-08-17T02:26:03.684338+0000","last_active":"2024-08-17T02:26:03.689568+0000","last_peered":"2024-08-17T02:26:03.689568+0000","last_clean":"2024-08-17T02:26:03.689568+0000","last_became_active":"2024-08-17T02:26:03.683895+0000","last_became_peered":"2024-08-17T02:26:03.683895+0000","last_unstale":"2024-08-17T02:26:03.689568+0000","last_undegraded":"2024-08-17T02:26:03.689568+0000","last_fullsized":"2024-08-17T02:26:03.689568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708118+0000","last_change":"2024-08-17T02:26:03.708118+0000","last_active":"2024-08-17T02:26:03.708118+0000","last_peered":"2024-08-17T02:26:03.708118+0000","last_clean":"2024-08-17T02:26:03.708118+0000","last_became_active":"2024-08-17T02:26:03.707028+0000","last_became_peered":"2024-08-17T02:26:03.707028+0000","last_unstale":"2024-08-17T02:26:03.708118+0000","last_undegraded":"2024-08-17T02:26:03.708118+0000","last_fullsized":"2024-08-17T02:26:03.708118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701029+0000","last_change":"2024-08-17T02:26:03.698278+0000","last_active":"2024-08-17T02:26:03.701029+0000","last_peered":"2024-08-17T02:26:03.701029+0000","last_clean":"2024-08-17T02:26:03.701029+0000","last_became_active":"2024-08-17T02:26:03.698031+0000","last_became_peered":"2024-08-17T02:26:03.698031+0000","last_unstale":"2024-08-17T02:26:03.701029+0000","last_undegraded":"2024-08-17T02:26:03.701029+0000","last_fullsized":"2024-08-17T02:26:03.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.694710+0000","last_change":"2024-08-17T02:26:03.694710+0000","last_active":"2024-08-17T02:26:03.694710+0000","last_peered":"2024-08-17T02:26:03.694710+0000","last_clean":"2024-08-17T02:26:03.694710+0000","last_became_active":"2024-08-17T02:26:03.693342+0000","last_became_peered":"2024-08-17T02:26:03.693342+0000","last_unstale":"2024-08-17T02:26:03.694710+0000","last_undegraded":"2024-08-17T02:26:03.694710+0000","last_fullsized":"2024-08-17T02:26:03.694710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701083+0000","last_change":"2024-08-17T02:26:03.698485+0000","last_active":"2024-08-17T02:26:03.701083+0000","last_peered":"2024-08-17T02:26:03.701083+0000","last_clean":"2024-08-17T02:26:03.701083+0000","last_became_active":"2024-08-17T02:26:03.698183+0000","last_became_peered":"2024-08-17T02:26:03.698183+0000","last_unstale":"2024-08-17T02:26:03.701083+0000","last_undegraded":"2024-08-17T02:26:03.701083+0000","last_fullsized":"2024-08-17T02:26:03.701083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707593+0000","last_change":"2024-08-17T02:26:03.707593+0000","last_active":"2024-08-17T02:26:03.707593+0000","last_peered":"2024-08-17T02:26:03.707593+0000","last_clean":"2024-08-17T02:26:03.707593+0000","last_became_active":"2024-08-17T02:26:03.707341+0000","last_became_peered":"2024-08-17T02:26:03.707341+0000","last_unstale":"2024-08-17T02:26:03.707593+0000","last_undegraded":"2024-08-17T02:26:03.707593+0000","last_fullsized":"2024-08-17T02:26:03.707593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.693165+0000","last_change":"2024-08-17T02:26:03.693165+0000","last_active":"2024-08-17T02:26:03.693165+0000","last_peered":"2024-08-17T02:26:03.693165+0000","last_clean":"2024-08-17T02:26:03.693165+0000","last_became_active":"2024-08-17T02:26:03.692908+0000","last_became_peered":"2024-08-17T02:26:03.692908+0000","last_unstale":"2024-08-17T02:26:03.693165+0000","last_undegraded":"2024-08-17T02:26:03.693165+0000","last_fullsized":"2024-08-17T02:26:03.693165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709161+0000","last_change":"2024-08-17T02:26:03.704953+0000","last_active":"2024-08-17T02:26:03.709161+0000","last_peered":"2024-08-17T02:26:03.709161+0000","last_clean":"2024-08-17T02:26:03.709161+0000","last_became_active":"2024-08-17T02:26:03.704774+0000","last_became_peered":"2024-08-17T02:26:03.704774+0000","last_unstale":"2024-08-17T02:26:03.709161+0000","last_undegraded":"2024-08-17T02:26:03.709161+0000","last_fullsized":"2024-08-17T02:26:03.709161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711737+0000","last_change":"2024-08-17T02:26:03.710637+0000","last_active":"2024-08-17T02:26:03.711737+0000","last_peered":"2024-08-17T02:26:03.711737+0000","last_clean":"2024-08-17T02:26:03.711737+0000","last_became_active":"2024-08-17T02:26:03.710268+0000","last_became_peered":"2024-08-17T02:26:03.710268+0000","last_unstale":"2024-08-17T02:26:03.711737+0000","last_undegraded":"2024-08-17T02:26:03.711737+0000","last_fullsized":"2024-08-17T02:26:03.711737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707884+0000","last_change":"2024-08-17T02:26:03.707884+0000","last_active":"2024-08-17T02:26:03.707884+0000","last_peered":"2024-08-17T02:26:03.707884+0000","last_clean":"2024-08-17T02:26:03.707884+0000","last_became_active":"2024-08-17T02:26:03.706445+0000","last_became_peered":"2024-08-17T02:26:03.706445+0000","last_unstale":"2024-08-17T02:26:03.707884+0000","last_undegraded":"2024-08-17T02:26:03.707884+0000","last_fullsized":"2024-08-17T02:26:03.707884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695921+0000","last_change":"2024-08-17T02:26:03.695921+0000","last_active":"2024-08-17T02:26:03.695921+0000","last_peered":"2024-08-17T02:26:03.695921+0000","last_clean":"2024-08-17T02:26:03.695921+0000","last_became_active":"2024-08-17T02:26:03.695608+0000","last_became_peered":"2024-08-17T02:26:03.695608+0000","last_unstale":"2024-08-17T02:26:03.695921+0000","last_undegraded":"2024-08-17T02:26:03.695921+0000","last_fullsized":"2024-08-17T02:26:03.695921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697117+0000","last_change":"2024-08-17T02:26:03.697117+0000","last_active":"2024-08-17T02:26:03.697117+0000","last_peered":"2024-08-17T02:26:03.697117+0000","last_clean":"2024-08-17T02:26:03.697117+0000","last_became_active":"2024-08-17T02:26:03.696545+0000","last_became_peered":"2024-08-17T02:26:03.696545+0000","last_unstale":"2024-08-17T02:26:03.697117+0000","last_undegraded":"2024-08-17T02:26:03.697117+0000","last_fullsized":"2024-08-17T02:26:03.697117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.692906+0000","last_change":"2024-08-17T02:26:03.692906+0000","last_active":"2024-08-17T02:26:03.692906+0000","last_peered":"2024-08-17T02:26:03.692906+0000","last_clean":"2024-08-17T02:26:03.692906+0000","last_became_active":"2024-08-17T02:26:03.690376+0000","last_became_peered":"2024-08-17T02:26:03.690376+0000","last_unstale":"2024-08-17T02:26:03.692906+0000","last_undegraded":"2024-08-17T02:26:03.692906+0000","last_fullsized":"2024-08-17T02:26:03.692906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708921+0000","last_change":"2024-08-17T02:26:02.683268+0000","last_active":"2024-08-17T02:26:03.708921+0000","last_peered":"2024-08-17T02:26:03.708921+0000","last_clean":"2024-08-17T02:26:03.708921+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.708921+0000","last_undegraded":"2024-08-17T02:26:03.708921+0000","last_fullsized":"2024-08-17T02:26:03.708921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700431+0000","last_change":"2024-08-17T02:26:03.696347+0000","last_active":"2024-08-17T02:26:03.700431+0000","last_peered":"2024-08-17T02:26:03.700431+0000","last_clean":"2024-08-17T02:26:03.700431+0000","last_became_active":"2024-08-17T02:26:03.696090+0000","last_became_peered":"2024-08-17T02:26:03.696090+0000","last_unstale":"2024-08-17T02:26:03.700431+0000","last_undegraded":"2024-08-17T02:26:03.700431+0000","last_fullsized":"2024-08-17T02:26:03.700431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702819+0000","last_change":"2024-08-17T02:26:02.692755+0000","last_active":"2024-08-17T02:26:03.702819+0000","last_peered":"2024-08-17T02:26:03.702819+0000","last_clean":"2024-08-17T02:26:03.702819+0000","last_became_active":"2024-08-17T02:26:02.692433+0000","last_became_peered":"2024-08-17T02:26:02.692433+0000","last_unstale":"2024-08-17T02:26:03.702819+0000","last_undegraded":"2024-08-17T02:26:03.702819+0000","last_fullsized":"2024-08-17T02:26:03.702819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.690965+0000","last_change":"2024-08-17T02:26:02.690367+0000","last_active":"2024-08-17T02:26:03.690965+0000","last_peered":"2024-08-17T02:26:03.690965+0000","last_clean":"2024-08-17T02:26:03.690965+0000","last_became_active":"2024-08-17T02:26:02.686604+0000","last_became_peered":"2024-08-17T02:26:02.686604+0000","last_unstale":"2024-08-17T02:26:03.690965+0000","last_undegraded":"2024-08-17T02:26:03.690965+0000","last_fullsized":"2024-08-17T02:26:03.690965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700829+0000","last_change":"2024-08-17T02:26:03.694153+0000","last_active":"2024-08-17T02:26:03.700829+0000","last_peered":"2024-08-17T02:26:03.700829+0000","last_clean":"2024-08-17T02:26:03.700829+0000","last_became_active":"2024-08-17T02:26:03.693219+0000","last_became_peered":"2024-08-17T02:26:03.693219+0000","last_unstale":"2024-08-17T02:26:03.700829+0000","last_undegraded":"2024-08-17T02:26:03.700829+0000","last_fullsized":"2024-08-17T02:26:03.700829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702251+0000","last_change":"2024-08-17T02:26:02.699358+0000","last_active":"2024-08-17T02:26:02.702251+0000","last_peered":"2024-08-17T02:26:02.702251+0000","last_clean":"2024-08-17T02:26:02.702251+0000","last_became_active":"2024-08-17T02:26:02.699049+0000","last_became_peered":"2024-08-17T02:26:02.699049+0000","last_unstale":"2024-08-17T02:26:02.702251+0000","last_undegraded":"2024-08-17T02:26:02.702251+0000","last_fullsized":"2024-08-17T02:26:02.702251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696889+0000","last_change":"2024-08-17T02:26:03.696889+0000","last_active":"2024-08-17T02:26:03.696889+0000","last_peered":"2024-08-17T02:26:03.696889+0000","last_clean":"2024-08-17T02:26:03.696889+0000","last_became_active":"2024-08-17T02:26:03.696643+0000","last_became_peered":"2024-08-17T02:26:03.696643+0000","last_unstale":"2024-08-17T02:26:03.696889+0000","last_undegraded":"2024-08-17T02:26:03.696889+0000","last_fullsized":"2024-08-17T02:26:03.696889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.704929+0000","last_change":"2024-08-17T02:26:02.698402+0000","last_active":"2024-08-17T02:26:02.704929+0000","last_peered":"2024-08-17T02:26:02.704929+0000","last_clean":"2024-08-17T02:26:02.704929+0000","last_became_active":"2024-08-17T02:26:02.698127+0000","last_became_peered":"2024-08-17T02:26:02.698127+0000","last_unstale":"2024-08-17T02:26:02.704929+0000","last_undegraded":"2024-08-17T02:26:02.704929+0000","last_fullsized":"2024-08-17T02:26:02.704929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706523+0000","last_change":"2024-08-17T02:26:03.706523+0000","last_active":"2024-08-17T02:26:03.706523+0000","last_peered":"2024-08-17T02:26:03.706523+0000","last_clean":"2024-08-17T02:26:03.706523+0000","last_became_active":"2024-08-17T02:26:03.706259+0000","last_became_peered":"2024-08-17T02:26:03.706259+0000","last_unstale":"2024-08-17T02:26:03.706523+0000","last_undegraded":"2024-08-17T02:26:03.706523+0000","last_fullsized":"2024-08-17T02:26:03.706523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702347+0000","last_change":"2024-08-17T02:26:02.697853+0000","last_active":"2024-08-17T02:26:02.702347+0000","last_peered":"2024-08-17T02:26:02.702347+0000","last_clean":"2024-08-17T02:26:02.702347+0000","last_became_active":"2024-08-17T02:26:02.697333+0000","last_became_peered":"2024-08-17T02:26:02.697333+0000","last_unstale":"2024-08-17T02:26:02.702347+0000","last_undegraded":"2024-08-17T02:26:02.702347+0000","last_fullsized":"2024-08-17T02:26:02.702347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700464+0000","last_change":"2024-08-17T02:26:03.697416+0000","last_active":"2024-08-17T02:26:03.700464+0000","last_peered":"2024-08-17T02:26:03.700464+0000","last_clean":"2024-08-17T02:26:03.700464+0000","last_became_active":"2024-08-17T02:26:03.697117+0000","last_became_peered":"2024-08-17T02:26:03.697117+0000","last_unstale":"2024-08-17T02:26:03.700464+0000","last_undegraded":"2024-08-17T02:26:03.700464+0000","last_fullsized":"2024-08-17T02:26:03.700464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.703978+0000","last_change":"2024-08-17T02:26:02.698299+0000","last_active":"2024-08-17T02:26:03.703978+0000","last_peered":"2024-08-17T02:26:03.703978+0000","last_clean":"2024-08-17T02:26:03.703978+0000","last_became_active":"2024-08-17T02:26:02.698048+0000","last_became_peered":"2024-08-17T02:26:02.698048+0000","last_unstale":"2024-08-17T02:26:03.703978+0000","last_undegraded":"2024-08-17T02:26:03.703978+0000","last_fullsized":"2024-08-17T02:26:03.703978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711973+0000","last_change":"2024-08-17T02:26:03.711973+0000","last_active":"2024-08-17T02:26:03.711973+0000","last_peered":"2024-08-17T02:26:03.711973+0000","last_clean":"2024-08-17T02:26:03.711973+0000","last_became_active":"2024-08-17T02:26:03.709989+0000","last_became_peered":"2024-08-17T02:26:03.709989+0000","last_unstale":"2024-08-17T02:26:03.711973+0000","last_undegraded":"2024-08-17T02:26:03.711973+0000","last_fullsized":"2024-08-17T02:26:03.711973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713083+0000","last_change":"2024-08-17T02:26:02.693614+0000","last_active":"2024-08-17T02:26:03.713083+0000","last_peered":"2024-08-17T02:26:03.713083+0000","last_clean":"2024-08-17T02:26:03.713083+0000","last_became_active":"2024-08-17T02:26:02.691439+0000","last_became_peered":"2024-08-17T02:26:02.691439+0000","last_unstale":"2024-08-17T02:26:03.713083+0000","last_undegraded":"2024-08-17T02:26:03.713083+0000","last_fullsized":"2024-08-17T02:26:03.713083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708522+0000","last_change":"2024-08-17T02:26:03.700840+0000","last_active":"2024-08-17T02:26:03.708522+0000","last_peered":"2024-08-17T02:26:03.708522+0000","last_clean":"2024-08-17T02:26:03.708522+0000","last_became_active":"2024-08-17T02:26:03.691916+0000","last_became_peered":"2024-08-17T02:26:03.691916+0000","last_unstale":"2024-08-17T02:26:03.708522+0000","last_undegraded":"2024-08-17T02:26:03.708522+0000","last_fullsized":"2024-08-17T02:26:03.708522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695917+0000","last_change":"2024-08-17T02:26:02.693440+0000","last_active":"2024-08-17T02:26:03.695917+0000","last_peered":"2024-08-17T02:26:03.695917+0000","last_clean":"2024-08-17T02:26:03.695917+0000","last_became_active":"2024-08-17T02:26:02.693121+0000","last_became_peered":"2024-08-17T02:26:02.693121+0000","last_unstale":"2024-08-17T02:26:03.695917+0000","last_undegraded":"2024-08-17T02:26:03.695917+0000","last_fullsized":"2024-08-17T02:26:03.695917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:11.874973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700196+0000","last_change":"2024-08-17T02:26:03.695504+0000","last_active":"2024-08-17T02:26:03.700196+0000","last_peered":"2024-08-17T02:26:03.700196+0000","last_clean":"2024-08-17T02:26:03.700196+0000","last_became_active":"2024-08-17T02:26:03.694472+0000","last_became_peered":"2024-08-17T02:26:03.694472+0000","last_unstale":"2024-08-17T02:26:03.700196+0000","last_undegraded":"2024-08-17T02:26:03.700196+0000","last_fullsized":"2024-08-17T02:26:03.700196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:16.565066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702155+0000","last_change":"2024-08-17T02:26:02.698302+0000","last_active":"2024-08-17T02:26:02.702155+0000","last_peered":"2024-08-17T02:26:02.702155+0000","last_clean":"2024-08-17T02:26:02.702155+0000","last_became_active":"2024-08-17T02:26:02.698027+0000","last_became_peered":"2024-08-17T02:26:02.698027+0000","last_unstale":"2024-08-17T02:26:02.702155+0000","last_undegraded":"2024-08-17T02:26:02.702155+0000","last_fullsized":"2024-08-17T02:26:02.702155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709234+0000","last_change":"2024-08-17T02:26:03.703475+0000","last_active":"2024-08-17T02:26:03.709234+0000","last_peered":"2024-08-17T02:26:03.709234+0000","last_clean":"2024-08-17T02:26:03.709234+0000","last_became_active":"2024-08-17T02:26:03.701071+0000","last_became_peered":"2024-08-17T02:26:03.701071+0000","last_unstale":"2024-08-17T02:26:03.709234+0000","last_undegraded":"2024-08-17T02:26:03.709234+0000","last_fullsized":"2024-08-17T02:26:03.709234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.694754+0000","last_change":"2024-08-17T02:26:02.693306+0000","last_active":"2024-08-17T02:26:02.694754+0000","last_peered":"2024-08-17T02:26:02.694754+0000","last_clean":"2024-08-17T02:26:02.694754+0000","last_became_active":"2024-08-17T02:26:02.692943+0000","last_became_peered":"2024-08-17T02:26:02.692943+0000","last_unstale":"2024-08-17T02:26:02.694754+0000","last_undegraded":"2024-08-17T02:26:02.694754+0000","last_fullsized":"2024-08-17T02:26:02.694754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696903+0000","last_change":"2024-08-17T02:26:03.696903+0000","last_active":"2024-08-17T02:26:03.696903+0000","last_peered":"2024-08-17T02:26:03.696903+0000","last_clean":"2024-08-17T02:26:03.696903+0000","last_became_active":"2024-08-17T02:26:03.696184+0000","last_became_peered":"2024-08-17T02:26:03.696184+0000","last_unstale":"2024-08-17T02:26:03.696903+0000","last_undegraded":"2024-08-17T02:26:03.696903+0000","last_fullsized":"2024-08-17T02:26:03.696903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705068+0000","last_change":"2024-08-17T02:26:02.686536+0000","last_active":"2024-08-17T02:26:03.705068+0000","last_peered":"2024-08-17T02:26:03.705068+0000","last_clean":"2024-08-17T02:26:03.705068+0000","last_became_active":"2024-08-17T02:26:02.686234+0000","last_became_peered":"2024-08-17T02:26:02.686234+0000","last_unstale":"2024-08-17T02:26:03.705068+0000","last_undegraded":"2024-08-17T02:26:03.705068+0000","last_fullsized":"2024-08-17T02:26:03.705068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710752+0000","last_change":"2024-08-17T02:26:03.705371+0000","last_active":"2024-08-17T02:26:03.710752+0000","last_peered":"2024-08-17T02:26:03.710752+0000","last_clean":"2024-08-17T02:26:03.710752+0000","last_became_active":"2024-08-17T02:26:03.703153+0000","last_became_peered":"2024-08-17T02:26:03.703153+0000","last_unstale":"2024-08-17T02:26:03.710752+0000","last_undegraded":"2024-08-17T02:26:03.710752+0000","last_fullsized":"2024-08-17T02:26:03.710752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.682337+0000","last_change":"2024-08-17T02:26:02.697624+0000","last_active":"2024-08-17T02:26:03.682337+0000","last_peered":"2024-08-17T02:26:03.682337+0000","last_clean":"2024-08-17T02:26:03.682337+0000","last_became_active":"2024-08-17T02:26:02.697417+0000","last_became_peered":"2024-08-17T02:26:02.697417+0000","last_unstale":"2024-08-17T02:26:03.682337+0000","last_undegraded":"2024-08-17T02:26:03.682337+0000","last_fullsized":"2024-08-17T02:26:03.682337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:09.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710177+0000","last_change":"2024-08-17T02:26:03.705614+0000","last_active":"2024-08-17T02:26:03.710177+0000","last_peered":"2024-08-17T02:26:03.710177+0000","last_clean":"2024-08-17T02:26:03.710177+0000","last_became_active":"2024-08-17T02:26:03.701211+0000","last_became_peered":"2024-08-17T02:26:03.701211+0000","last_unstale":"2024-08-17T02:26:03.710177+0000","last_undegraded":"2024-08-17T02:26:03.710177+0000","last_fullsized":"2024-08-17T02:26:03.710177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704765+0000","last_change":"2024-08-17T02:26:02.686432+0000","last_active":"2024-08-17T02:26:03.704765+0000","last_peered":"2024-08-17T02:26:03.704765+0000","last_clean":"2024-08-17T02:26:03.704765+0000","last_became_active":"2024-08-17T02:26:02.686122+0000","last_became_peered":"2024-08-17T02:26:02.686122+0000","last_unstale":"2024-08-17T02:26:03.704765+0000","last_undegraded":"2024-08-17T02:26:03.704765+0000","last_fullsized":"2024-08-17T02:26:03.704765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710286+0000","last_change":"2024-08-17T02:26:03.707361+0000","last_active":"2024-08-17T02:26:03.710286+0000","last_peered":"2024-08-17T02:26:03.710286+0000","last_clean":"2024-08-17T02:26:03.710286+0000","last_became_active":"2024-08-17T02:26:03.702988+0000","last_became_peered":"2024-08-17T02:26:03.702988+0000","last_unstale":"2024-08-17T02:26:03.710286+0000","last_undegraded":"2024-08-17T02:26:03.710286+0000","last_fullsized":"2024-08-17T02:26:03.710286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674987+0000","last_change":"2024-08-17T02:26:02.691873+0000","last_active":"2024-08-17T02:26:03.674987+0000","last_peered":"2024-08-17T02:26:03.674987+0000","last_clean":"2024-08-17T02:26:03.674987+0000","last_became_active":"2024-08-17T02:26:02.691585+0000","last_became_peered":"2024-08-17T02:26:02.691585+0000","last_unstale":"2024-08-17T02:26:03.674987+0000","last_undegraded":"2024-08-17T02:26:03.674987+0000","last_fullsized":"2024-08-17T02:26:03.674987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695043+0000","last_change":"2024-08-17T02:26:03.695043+0000","last_active":"2024-08-17T02:26:03.695043+0000","last_peered":"2024-08-17T02:26:03.695043+0000","last_clean":"2024-08-17T02:26:03.695043+0000","last_became_active":"2024-08-17T02:26:03.694187+0000","last_became_peered":"2024-08-17T02:26:03.694187+0000","last_unstale":"2024-08-17T02:26:03.695043+0000","last_undegraded":"2024-08-17T02:26:03.695043+0000","last_fullsized":"2024-08-17T02:26:03.695043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.700095+0000","last_change":"2024-08-17T02:26:02.698483+0000","last_active":"2024-08-17T02:26:02.700095+0000","last_peered":"2024-08-17T02:26:02.700095+0000","last_clean":"2024-08-17T02:26:02.700095+0000","last_became_active":"2024-08-17T02:26:02.698229+0000","last_became_peered":"2024-08-17T02:26:02.698229+0000","last_unstale":"2024-08-17T02:26:02.700095+0000","last_undegraded":"2024-08-17T02:26:02.700095+0000","last_fullsized":"2024-08-17T02:26:02.700095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710151+0000","last_change":"2024-08-17T02:26:03.703895+0000","last_active":"2024-08-17T02:26:03.710151+0000","last_peered":"2024-08-17T02:26:03.710151+0000","last_clean":"2024-08-17T02:26:03.710151+0000","last_became_active":"2024-08-17T02:26:03.703616+0000","last_became_peered":"2024-08-17T02:26:03.703616+0000","last_unstale":"2024-08-17T02:26:03.710151+0000","last_undegraded":"2024-08-17T02:26:03.710151+0000","last_fullsized":"2024-08-17T02:26:03.710151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:46.487161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674444+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:03.674444+0000","last_peered":"2024-08-17T02:26:03.674444+0000","last_clean":"2024-08-17T02:26:03.674444+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:03.674444+0000","last_undegraded":"2024-08-17T02:26:03.674444+0000","last_fullsized":"2024-08-17T02:26:03.674444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.697360+0000","last_change":"2024-08-17T02:26:02.691288+0000","last_active":"2024-08-17T02:26:02.697360+0000","last_peered":"2024-08-17T02:26:02.697360+0000","last_clean":"2024-08-17T02:26:02.697360+0000","last_became_active":"2024-08-17T02:26:02.691023+0000","last_became_peered":"2024-08-17T02:26:02.691023+0000","last_unstale":"2024-08-17T02:26:02.697360+0000","last_undegraded":"2024-08-17T02:26:02.697360+0000","last_fullsized":"2024-08-17T02:26:02.697360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707843+0000","last_change":"2024-08-17T02:26:03.705291+0000","last_active":"2024-08-17T02:26:03.707843+0000","last_peered":"2024-08-17T02:26:03.707843+0000","last_clean":"2024-08-17T02:26:03.707843+0000","last_became_active":"2024-08-17T02:26:03.704669+0000","last_became_peered":"2024-08-17T02:26:03.704669+0000","last_unstale":"2024-08-17T02:26:03.707843+0000","last_undegraded":"2024-08-17T02:26:03.707843+0000","last_fullsized":"2024-08-17T02:26:03.707843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674432+0000","last_change":"2024-08-17T02:26:02.683352+0000","last_active":"2024-08-17T02:26:03.674432+0000","last_peered":"2024-08-17T02:26:03.674432+0000","last_clean":"2024-08-17T02:26:03.674432+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.674432+0000","last_undegraded":"2024-08-17T02:26:03.674432+0000","last_fullsized":"2024-08-17T02:26:03.674432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700402+0000","last_change":"2024-08-17T02:26:03.695517+0000","last_active":"2024-08-17T02:26:03.700402+0000","last_peered":"2024-08-17T02:26:03.700402+0000","last_clean":"2024-08-17T02:26:03.700402+0000","last_became_active":"2024-08-17T02:26:03.694448+0000","last_became_peered":"2024-08-17T02:26:03.694448+0000","last_unstale":"2024-08-17T02:26:03.700402+0000","last_undegraded":"2024-08-17T02:26:03.700402+0000","last_fullsized":"2024-08-17T02:26:03.700402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.689209+0000","last_change":"2024-08-17T02:26:02.681358+0000","last_active":"2024-08-17T02:26:02.689209+0000","last_peered":"2024-08-17T02:26:02.689209+0000","last_clean":"2024-08-17T02:26:02.689209+0000","last_became_active":"2024-08-17T02:26:02.681132+0000","last_became_peered":"2024-08-17T02:26:02.681132+0000","last_unstale":"2024-08-17T02:26:02.689209+0000","last_undegraded":"2024-08-17T02:26:02.689209+0000","last_fullsized":"2024-08-17T02:26:02.689209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.685671+0000","last_change":"2024-08-17T02:26:03.685671+0000","last_active":"2024-08-17T02:26:03.685671+0000","last_peered":"2024-08-17T02:26:03.685671+0000","last_clean":"2024-08-17T02:26:03.685671+0000","last_became_active":"2024-08-17T02:26:03.685342+0000","last_became_peered":"2024-08-17T02:26:03.685342+0000","last_unstale":"2024-08-17T02:26:03.685671+0000","last_undegraded":"2024-08-17T02:26:03.685671+0000","last_fullsized":"2024-08-17T02:26:03.685671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702117+0000","last_change":"2024-08-17T02:26:02.697313+0000","last_active":"2024-08-17T02:26:02.702117+0000","last_peered":"2024-08-17T02:26:02.702117+0000","last_clean":"2024-08-17T02:26:02.702117+0000","last_became_active":"2024-08-17T02:26:02.693931+0000","last_became_peered":"2024-08-17T02:26:02.693931+0000","last_unstale":"2024-08-17T02:26:02.702117+0000","last_undegraded":"2024-08-17T02:26:02.702117+0000","last_fullsized":"2024-08-17T02:26:02.702117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.698206+0000","last_change":"2024-08-17T02:26:03.698206+0000","last_active":"2024-08-17T02:26:03.698206+0000","last_peered":"2024-08-17T02:26:03.698206+0000","last_clean":"2024-08-17T02:26:03.698206+0000","last_became_active":"2024-08-17T02:26:03.696941+0000","last_became_peered":"2024-08-17T02:26:03.696941+0000","last_unstale":"2024-08-17T02:26:03.698206+0000","last_undegraded":"2024-08-17T02:26:03.698206+0000","last_fullsized":"2024-08-17T02:26:03.698206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:32.247498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.693908+0000","last_change":"2024-08-17T02:26:02.689793+0000","last_active":"2024-08-17T02:26:02.693908+0000","last_peered":"2024-08-17T02:26:02.693908+0000","last_clean":"2024-08-17T02:26:02.693908+0000","last_became_active":"2024-08-17T02:26:02.689266+0000","last_became_peered":"2024-08-17T02:26:02.689266+0000","last_unstale":"2024-08-17T02:26:02.693908+0000","last_undegraded":"2024-08-17T02:26:02.693908+0000","last_fullsized":"2024-08-17T02:26:02.693908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696041+0000","last_change":"2024-08-17T02:26:03.696041+0000","last_active":"2024-08-17T02:26:03.696041+0000","last_peered":"2024-08-17T02:26:03.696041+0000","last_clean":"2024-08-17T02:26:03.696041+0000","last_became_active":"2024-08-17T02:26:03.695675+0000","last_became_peered":"2024-08-17T02:26:03.695675+0000","last_unstale":"2024-08-17T02:26:03.696041+0000","last_undegraded":"2024-08-17T02:26:03.696041+0000","last_fullsized":"2024-08-17T02:26:03.696041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.676108+0000","last_change":"2024-08-17T02:26:02.691075+0000","last_active":"2024-08-17T02:26:03.676108+0000","last_peered":"2024-08-17T02:26:03.676108+0000","last_clean":"2024-08-17T02:26:03.676108+0000","last_became_active":"2024-08-17T02:26:02.690601+0000","last_became_peered":"2024-08-17T02:26:02.690601+0000","last_unstale":"2024-08-17T02:26:03.676108+0000","last_undegraded":"2024-08-17T02:26:03.676108+0000","last_fullsized":"2024-08-17T02:26:03.676108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:15.556656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686234+0000","last_change":"2024-08-17T02:26:03.686234+0000","last_active":"2024-08-17T02:26:03.686234+0000","last_peered":"2024-08-17T02:26:03.686234+0000","last_clean":"2024-08-17T02:26:03.686234+0000","last_became_active":"2024-08-17T02:26:03.685409+0000","last_became_peered":"2024-08-17T02:26:03.685409+0000","last_unstale":"2024-08-17T02:26:03.686234+0000","last_undegraded":"2024-08-17T02:26:03.686234+0000","last_fullsized":"2024-08-17T02:26:03.686234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.697136+0000","last_change":"2024-08-17T02:26:02.694328+0000","last_active":"2024-08-17T02:26:02.697136+0000","last_peered":"2024-08-17T02:26:02.697136+0000","last_clean":"2024-08-17T02:26:02.697136+0000","last_became_active":"2024-08-17T02:26:02.693978+0000","last_became_peered":"2024-08-17T02:26:02.693978+0000","last_unstale":"2024-08-17T02:26:02.697136+0000","last_undegraded":"2024-08-17T02:26:02.697136+0000","last_fullsized":"2024-08-17T02:26:02.697136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710044+0000","last_change":"2024-08-17T02:26:03.708726+0000","last_active":"2024-08-17T02:26:03.710044+0000","last_peered":"2024-08-17T02:26:03.710044+0000","last_clean":"2024-08-17T02:26:03.710044+0000","last_became_active":"2024-08-17T02:26:03.708552+0000","last_became_peered":"2024-08-17T02:26:03.708552+0000","last_unstale":"2024-08-17T02:26:03.710044+0000","last_undegraded":"2024-08-17T02:26:03.710044+0000","last_fullsized":"2024-08-17T02:26:03.710044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710926+0000","last_change":"2024-08-17T02:26:02.700098+0000","last_active":"2024-08-17T02:26:03.710926+0000","last_peered":"2024-08-17T02:26:03.710926+0000","last_clean":"2024-08-17T02:26:03.710926+0000","last_became_active":"2024-08-17T02:26:02.699846+0000","last_became_peered":"2024-08-17T02:26:02.699846+0000","last_unstale":"2024-08-17T02:26:03.710926+0000","last_undegraded":"2024-08-17T02:26:03.710926+0000","last_fullsized":"2024-08-17T02:26:03.710926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.681734+0000","last_change":"2024-08-17T02:26:03.678930+0000","last_active":"2024-08-17T02:26:03.681734+0000","last_peered":"2024-08-17T02:26:03.681734+0000","last_clean":"2024-08-17T02:26:03.681734+0000","last_became_active":"2024-08-17T02:26:03.678664+0000","last_became_peered":"2024-08-17T02:26:03.678664+0000","last_unstale":"2024-08-17T02:26:03.681734+0000","last_undegraded":"2024-08-17T02:26:03.681734+0000","last_fullsized":"2024-08-17T02:26:03.681734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674335+0000","last_change":"2024-08-17T02:26:02.691047+0000","last_active":"2024-08-17T02:26:03.674335+0000","last_peered":"2024-08-17T02:26:03.674335+0000","last_clean":"2024-08-17T02:26:03.674335+0000","last_became_active":"2024-08-17T02:26:02.690711+0000","last_became_peered":"2024-08-17T02:26:02.690711+0000","last_unstale":"2024-08-17T02:26:03.674335+0000","last_undegraded":"2024-08-17T02:26:03.674335+0000","last_fullsized":"2024-08-17T02:26:03.674335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:31.239087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696174+0000","last_change":"2024-08-17T02:26:03.696174+0000","last_active":"2024-08-17T02:26:03.696174+0000","last_peered":"2024-08-17T02:26:03.696174+0000","last_clean":"2024-08-17T02:26:03.696174+0000","last_became_active":"2024-08-17T02:26:03.695719+0000","last_became_peered":"2024-08-17T02:26:03.695719+0000","last_unstale":"2024-08-17T02:26:03.696174+0000","last_undegraded":"2024-08-17T02:26:03.696174+0000","last_fullsized":"2024-08-17T02:26:03.696174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:47.054753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.687129+0000","last_change":"2024-08-17T02:26:02.683782+0000","last_active":"2024-08-17T02:26:02.687129+0000","last_peered":"2024-08-17T02:26:02.687129+0000","last_clean":"2024-08-17T02:26:02.687129+0000","last_became_active":"2024-08-17T02:26:02.681787+0000","last_became_peered":"2024-08-17T02:26:02.681787+0000","last_unstale":"2024-08-17T02:26:02.687129+0000","last_undegraded":"2024-08-17T02:26:02.687129+0000","last_fullsized":"2024-08-17T02:26:02.687129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700808+0000","last_change":"2024-08-17T02:26:03.692440+0000","last_active":"2024-08-17T02:26:03.700808+0000","last_peered":"2024-08-17T02:26:03.700808+0000","last_clean":"2024-08-17T02:26:03.700808+0000","last_became_active":"2024-08-17T02:26:03.691740+0000","last_became_peered":"2024-08-17T02:26:03.691740+0000","last_unstale":"2024-08-17T02:26:03.700808+0000","last_undegraded":"2024-08-17T02:26:03.700808+0000","last_fullsized":"2024-08-17T02:26:03.700808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.686674+0000","last_change":"2024-08-17T02:26:02.682746+0000","last_active":"2024-08-17T02:26:02.686674+0000","last_peered":"2024-08-17T02:26:02.686674+0000","last_clean":"2024-08-17T02:26:02.686674+0000","last_became_active":"2024-08-17T02:26:02.677985+0000","last_became_peered":"2024-08-17T02:26:02.677985+0000","last_unstale":"2024-08-17T02:26:02.686674+0000","last_undegraded":"2024-08-17T02:26:02.686674+0000","last_fullsized":"2024-08-17T02:26:02.686674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701339+0000","last_change":"2024-08-17T02:26:03.694939+0000","last_active":"2024-08-17T02:26:03.701339+0000","last_peered":"2024-08-17T02:26:03.701339+0000","last_clean":"2024-08-17T02:26:03.701339+0000","last_became_active":"2024-08-17T02:26:03.694230+0000","last_became_peered":"2024-08-17T02:26:03.694230+0000","last_unstale":"2024-08-17T02:26:03.701339+0000","last_undegraded":"2024-08-17T02:26:03.701339+0000","last_fullsized":"2024-08-17T02:26:03.701339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713165+0000","last_change":"2024-08-17T02:26:02.695510+0000","last_active":"2024-08-17T02:26:03.713165+0000","last_peered":"2024-08-17T02:26:03.713165+0000","last_clean":"2024-08-17T02:26:03.713165+0000","last_became_active":"2024-08-17T02:26:02.695315+0000","last_became_peered":"2024-08-17T02:26:02.695315+0000","last_unstale":"2024-08-17T02:26:03.713165+0000","last_undegraded":"2024-08-17T02:26:03.713165+0000","last_fullsized":"2024-08-17T02:26:03.713165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704528+0000","last_change":"2024-08-17T02:26:03.704528+0000","last_active":"2024-08-17T02:26:03.704528+0000","last_peered":"2024-08-17T02:26:03.704528+0000","last_clean":"2024-08-17T02:26:03.704528+0000","last_became_active":"2024-08-17T02:26:03.693099+0000","last_became_peered":"2024-08-17T02:26:03.693099+0000","last_unstale":"2024-08-17T02:26:03.704528+0000","last_undegraded":"2024-08-17T02:26:03.704528+0000","last_fullsized":"2024-08-17T02:26:03.704528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699962+0000","last_change":"2024-08-17T02:26:03.699962+0000","last_active":"2024-08-17T02:26:03.699962+0000","last_peered":"2024-08-17T02:26:03.699962+0000","last_clean":"2024-08-17T02:26:03.699962+0000","last_became_active":"2024-08-17T02:26:03.699542+0000","last_became_peered":"2024-08-17T02:26:03.699542+0000","last_unstale":"2024-08-17T02:26:03.699962+0000","last_undegraded":"2024-08-17T02:26:03.699962+0000","last_fullsized":"2024-08-17T02:26:03.699962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713543+0000","last_change":"2024-08-17T02:26:02.699093+0000","last_active":"2024-08-17T02:26:03.713543+0000","last_peered":"2024-08-17T02:26:03.713543+0000","last_clean":"2024-08-17T02:26:03.713543+0000","last_became_active":"2024-08-17T02:26:02.698750+0000","last_became_peered":"2024-08-17T02:26:02.698750+0000","last_unstale":"2024-08-17T02:26:03.713543+0000","last_undegraded":"2024-08-17T02:26:03.713543+0000","last_fullsized":"2024-08-17T02:26:03.713543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695207+0000","last_change":"2024-08-17T02:26:03.695207+0000","last_active":"2024-08-17T02:26:03.695207+0000","last_peered":"2024-08-17T02:26:03.695207+0000","last_clean":"2024-08-17T02:26:03.695207+0000","last_became_active":"2024-08-17T02:26:03.694474+0000","last_became_peered":"2024-08-17T02:26:03.694474+0000","last_unstale":"2024-08-17T02:26:03.695207+0000","last_undegraded":"2024-08-17T02:26:03.695207+0000","last_fullsized":"2024-08-17T02:26:03.695207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712848+0000","last_change":"2024-08-17T02:26:02.694813+0000","last_active":"2024-08-17T02:26:03.712848+0000","last_peered":"2024-08-17T02:26:03.712848+0000","last_clean":"2024-08-17T02:26:03.712848+0000","last_became_active":"2024-08-17T02:26:02.694536+0000","last_became_peered":"2024-08-17T02:26:02.694536+0000","last_unstale":"2024-08-17T02:26:03.712848+0000","last_undegraded":"2024-08-17T02:26:03.712848+0000","last_fullsized":"2024-08-17T02:26:03.712848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700480+0000","last_change":"2024-08-17T02:26:03.697467+0000","last_active":"2024-08-17T02:26:03.700480+0000","last_peered":"2024-08-17T02:26:03.700480+0000","last_clean":"2024-08-17T02:26:03.700480+0000","last_became_active":"2024-08-17T02:26:03.697216+0000","last_became_peered":"2024-08-17T02:26:03.697216+0000","last_unstale":"2024-08-17T02:26:03.700480+0000","last_undegraded":"2024-08-17T02:26:03.700480+0000","last_fullsized":"2024-08-17T02:26:03.700480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711824+0000","last_change":"2024-08-17T02:26:02.690442+0000","last_active":"2024-08-17T02:26:03.711824+0000","last_peered":"2024-08-17T02:26:03.711824+0000","last_clean":"2024-08-17T02:26:03.711824+0000","last_became_active":"2024-08-17T02:26:02.689103+0000","last_became_peered":"2024-08-17T02:26:02.689103+0000","last_unstale":"2024-08-17T02:26:03.711824+0000","last_undegraded":"2024-08-17T02:26:03.711824+0000","last_fullsized":"2024-08-17T02:26:03.711824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710009+0000","last_change":"2024-08-17T02:26:03.705516+0000","last_active":"2024-08-17T02:26:03.710009+0000","last_peered":"2024-08-17T02:26:03.710009+0000","last_clean":"2024-08-17T02:26:03.710009+0000","last_became_active":"2024-08-17T02:26:03.705299+0000","last_became_peered":"2024-08-17T02:26:03.705299+0000","last_unstale":"2024-08-17T02:26:03.710009+0000","last_undegraded":"2024-08-17T02:26:03.710009+0000","last_fullsized":"2024-08-17T02:26:03.710009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710612+0000","last_change":"2024-08-17T02:26:02.698824+0000","last_active":"2024-08-17T02:26:03.710612+0000","last_peered":"2024-08-17T02:26:03.710612+0000","last_clean":"2024-08-17T02:26:03.710612+0000","last_became_active":"2024-08-17T02:26:02.698592+0000","last_became_peered":"2024-08-17T02:26:02.698592+0000","last_unstale":"2024-08-17T02:26:03.710612+0000","last_undegraded":"2024-08-17T02:26:03.710612+0000","last_fullsized":"2024-08-17T02:26:03.710612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":196608,"data_stored":64456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":64492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":200704,"data_stored":64526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:07.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:08.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.021+0000 7fd5a5200640 1 Processor -- start 2024-08-17T02:26:08.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.021+0000 7fd5a5200640 1 -- start start 2024-08-17T02:26:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd5a5200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a0158bd0 0x7fd5a0069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd5a5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5a0069540 0x7fd5a00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd5a5200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00aec20 con 0x7fd5a00ac540 2024-08-17T02:26:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd5a5200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a0069990 con 0x7fd5a0069540 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd5a5200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00ae330 con 0x7fd5a0158bd0 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5a0069540 0x7fd5a00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5a0069540 0x7fd5a00ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40108/0 (socket says 172.21.15.146:40108) 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 -- 172.21.15.146:0/959192039 learned_addr learned my addr 172.21.15.146:0/959192039 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd59fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd5a00ac540 0x7fd5a0067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55812/0 (socket says 172.21.15.146:55812) 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd59f400640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a0158bd0 0x7fd5a0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 -- 172.21.15.146:0/959192039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a0158bd0 msgr2=0x7fd5a0069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a0158bd0 0x7fd5a0069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 -- 172.21.15.146:0/959192039 >> v1:172.21.15.146:6789/0 conn(0x7fd5a00ac540 legacy=0x7fd5a0067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd596a00640 1 -- 172.21.15.146:0/959192039 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00acd30 con 0x7fd5a0069540 2024-08-17T02:26:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.023+0000 7fd59ea00640 1 -- 172.21.15.146:0/959192039 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454946771 0 0) 0x7fd5a00aec20 con 0x7fd5a00ac540 2024-08-17T02:26:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.024+0000 7fd596a00640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0069540 0x7fd5a00ac000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd588009910 tx=0x7fd5880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dad70ead4edd59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd59ea00640 1 -- 172.21.15.146:0/959192039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58802adb0 con 0x7fd5a0069540 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd59ea00640 1 -- 172.21.15.146:0/959192039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588032440 con 0x7fd5a0069540 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd59ea00640 1 -- 172.21.15.146:0/959192039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880327e0 con 0x7fd5a0069540 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 -- 172.21.15.146:0/959192039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0069540 msgr2=0x7fd5a00ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0069540 0x7fd5a00ac000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd588009910 tx=0x7fd5880091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 -- 172.21.15.146:0/959192039 shutdown_connections 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0069540 0x7fd5a00ac000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 --2- 172.21.15.146:0/959192039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a0158bd0 0x7fd5a0069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 -- 172.21.15.146:0/959192039 >> 172.21.15.146:0/959192039 conn(0x7fd5a0096a70 msgr2=0x7fd5a00cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 -- 172.21.15.146:0/959192039 shutdown_connections 2024-08-17T02:26:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.025+0000 7fd5a5200640 1 -- 172.21.15.146:0/959192039 wait complete. 2024-08-17T02:26:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.027+0000 7fd5a5200640 1 Processor -- start 2024-08-17T02:26:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.027+0000 7fd5a5200640 1 -- start start 2024-08-17T02:26:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a0069540 0x7fd5a01697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a00ac540 0x7fd5a00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a015c1e0 con 0x7fd5a0158bd0 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a015c480 con 0x7fd5a0069540 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd5a5200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00b2a90 con 0x7fd5a00ac540 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40116/0 (socket says 172.21.15.146:40116) 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 -- 172.21.15.146:0/352821338 learned_addr learned my addr 172.21.15.146:0/352821338 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd596a00640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a00ac540 0x7fd5a00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59f400640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a0069540 0x7fd5a01697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 -- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a00ac540 msgr2=0x7fd5a00b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a00ac540 0x7fd5a00b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 -- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a0069540 msgr2=0x7fd5a01697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a0069540 0x7fd5a01697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.028+0000 7fd59fe00640 1 -- 172.21.15.146:0/352821338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009450 con 0x7fd5a0158bd0 2024-08-17T02:26:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd59fe00640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c960 tx=0x7fd5980016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598005d60 con 0x7fd5a0158bd0 2024-08-17T02:26:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800a640 con 0x7fd5a0158bd0 2024-08-17T02:26:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a00b2d30 con 0x7fd5a0158bd0 2024-08-17T02:26:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800aa00 con 0x7fd5a0158bd0 2024-08-17T02:26:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.029+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a00b32f0 con 0x7fd5a0158bd0 2024-08-17T02:26:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.030+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0071050 con 0x7fd5a0158bd0 2024-08-17T02:26:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.031+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd5980070f0 con 0x7fd5a0158bd0 2024-08-17T02:26:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.032+0000 7fd597400640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 0x7fd57c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.032+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd598082190 con 0x7fd5a0158bd0 2024-08-17T02:26:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.032+0000 7fd59f400640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 0x7fd57c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.032+0000 7fd59f400640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 0x7fd57c067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5a015bee0 tx=0x7fd5900090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.036+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd5980502e0 con 0x7fd5a0158bd0 2024-08-17T02:26:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.208+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5a00ce850 con 0x7fd57c065150 2024-08-17T02:26:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.215+0000 7fd597400640 1 -- 172.21.15.146:0/352821338 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264661 (secure 0 0 0) 0x7fd5a00ce850 con 0x7fd57c065150 2024-08-17T02:26:08.218 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 msgr2=0x7fd57c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 0x7fd57c067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd5a015bee0 tx=0x7fd5900090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 msgr2=0x7fd5a00b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c960 tx=0x7fd5980016c0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 shutdown_connections 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd57c065150 0x7fd57c067600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a0158bd0 0x7fd5a00b06f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a00ac540 0x7fd5a00b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 --2- 172.21.15.146:0/352821338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a0069540 0x7fd5a01697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 >> 172.21.15.146:0/352821338 conn(0x7fd5a0096a70 msgr2=0x7fd5a0067b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 shutdown_connections 2024-08-17T02:26:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.219+0000 7fd5a5200640 1 -- 172.21.15.146:0/352821338 wait complete. 2024-08-17T02:26:08.234 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:26:06.321064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381648,"kb_used_data":2764,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593072,"statfs":{"total":773094113280,"available":770655305728,"internally_reserved":0,"allocated":2830336,"data_stored":1719204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.663149"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710211+0000","last_change":"2024-08-17T02:26:03.706448+0000","last_active":"2024-08-17T02:26:03.710211+0000","last_peered":"2024-08-17T02:26:03.710211+0000","last_clean":"2024-08-17T02:26:03.710211+0000","last_became_active":"2024-08-17T02:26:03.691979+0000","last_became_peered":"2024-08-17T02:26:03.691979+0000","last_unstale":"2024-08-17T02:26:03.710211+0000","last_undegraded":"2024-08-17T02:26:03.710211+0000","last_fullsized":"2024-08-17T02:26:03.710211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683666+0000","last_change":"2024-08-17T02:26:03.683666+0000","last_active":"2024-08-17T02:26:03.683666+0000","last_peered":"2024-08-17T02:26:03.683666+0000","last_clean":"2024-08-17T02:26:03.683666+0000","last_became_active":"2024-08-17T02:26:03.683431+0000","last_became_peered":"2024-08-17T02:26:03.683431+0000","last_unstale":"2024-08-17T02:26:03.683666+0000","last_undegraded":"2024-08-17T02:26:03.683666+0000","last_fullsized":"2024-08-17T02:26:03.683666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686845+0000","last_change":"2024-08-17T02:26:03.684515+0000","last_active":"2024-08-17T02:26:03.686845+0000","last_peered":"2024-08-17T02:26:03.686845+0000","last_clean":"2024-08-17T02:26:03.686845+0000","last_became_active":"2024-08-17T02:26:03.684225+0000","last_became_peered":"2024-08-17T02:26:03.684225+0000","last_unstale":"2024-08-17T02:26:03.686845+0000","last_undegraded":"2024-08-17T02:26:03.686845+0000","last_fullsized":"2024-08-17T02:26:03.686845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:48.325629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695442+0000","last_change":"2024-08-17T02:26:03.695442+0000","last_active":"2024-08-17T02:26:03.695442+0000","last_peered":"2024-08-17T02:26:03.695442+0000","last_clean":"2024-08-17T02:26:03.695442+0000","last_became_active":"2024-08-17T02:26:03.694771+0000","last_became_peered":"2024-08-17T02:26:03.694771+0000","last_unstale":"2024-08-17T02:26:03.695442+0000","last_undegraded":"2024-08-17T02:26:03.695442+0000","last_fullsized":"2024-08-17T02:26:03.695442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706316+0000","last_change":"2024-08-17T02:26:03.691208+0000","last_active":"2024-08-17T02:26:03.706316+0000","last_peered":"2024-08-17T02:26:03.706316+0000","last_clean":"2024-08-17T02:26:03.706316+0000","last_became_active":"2024-08-17T02:26:03.690708+0000","last_became_peered":"2024-08-17T02:26:03.690708+0000","last_unstale":"2024-08-17T02:26:03.706316+0000","last_undegraded":"2024-08-17T02:26:03.706316+0000","last_fullsized":"2024-08-17T02:26:03.706316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696680+0000","last_change":"2024-08-17T02:26:03.696680+0000","last_active":"2024-08-17T02:26:03.696680+0000","last_peered":"2024-08-17T02:26:03.696680+0000","last_clean":"2024-08-17T02:26:03.696680+0000","last_became_active":"2024-08-17T02:26:03.696347+0000","last_became_peered":"2024-08-17T02:26:03.696347+0000","last_unstale":"2024-08-17T02:26:03.696680+0000","last_undegraded":"2024-08-17T02:26:03.696680+0000","last_fullsized":"2024-08-17T02:26:03.696680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705465+0000","last_change":"2024-08-17T02:26:03.690098+0000","last_active":"2024-08-17T02:26:03.705465+0000","last_peered":"2024-08-17T02:26:03.705465+0000","last_clean":"2024-08-17T02:26:03.705465+0000","last_became_active":"2024-08-17T02:26:03.688253+0000","last_became_peered":"2024-08-17T02:26:03.688253+0000","last_unstale":"2024-08-17T02:26:03.705465+0000","last_undegraded":"2024-08-17T02:26:03.705465+0000","last_fullsized":"2024-08-17T02:26:03.705465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707688+0000","last_change":"2024-08-17T02:26:03.704945+0000","last_active":"2024-08-17T02:26:03.707688+0000","last_peered":"2024-08-17T02:26:03.707688+0000","last_clean":"2024-08-17T02:26:03.707688+0000","last_became_active":"2024-08-17T02:26:03.704138+0000","last_became_peered":"2024-08-17T02:26:03.704138+0000","last_unstale":"2024-08-17T02:26:03.707688+0000","last_undegraded":"2024-08-17T02:26:03.707688+0000","last_fullsized":"2024-08-17T02:26:03.707688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710295+0000","last_change":"2024-08-17T02:26:03.707594+0000","last_active":"2024-08-17T02:26:03.710295+0000","last_peered":"2024-08-17T02:26:03.710295+0000","last_clean":"2024-08-17T02:26:03.710295+0000","last_became_active":"2024-08-17T02:26:03.707040+0000","last_became_peered":"2024-08-17T02:26:03.707040+0000","last_unstale":"2024-08-17T02:26:03.710295+0000","last_undegraded":"2024-08-17T02:26:03.710295+0000","last_fullsized":"2024-08-17T02:26:03.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.711882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699269+0000","last_change":"2024-08-17T02:26:03.699269+0000","last_active":"2024-08-17T02:26:03.699269+0000","last_peered":"2024-08-17T02:26:03.699269+0000","last_clean":"2024-08-17T02:26:03.699269+0000","last_became_active":"2024-08-17T02:26:03.698978+0000","last_became_peered":"2024-08-17T02:26:03.698978+0000","last_unstale":"2024-08-17T02:26:03.699269+0000","last_undegraded":"2024-08-17T02:26:03.699269+0000","last_fullsized":"2024-08-17T02:26:03.699269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699531+0000","last_change":"2024-08-17T02:26:03.699531+0000","last_active":"2024-08-17T02:26:03.699531+0000","last_peered":"2024-08-17T02:26:03.699531+0000","last_clean":"2024-08-17T02:26:03.699531+0000","last_became_active":"2024-08-17T02:26:03.699231+0000","last_became_peered":"2024-08-17T02:26:03.699231+0000","last_unstale":"2024-08-17T02:26:03.699531+0000","last_undegraded":"2024-08-17T02:26:03.699531+0000","last_fullsized":"2024-08-17T02:26:03.699531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699887+0000","last_change":"2024-08-17T02:26:03.699887+0000","last_active":"2024-08-17T02:26:03.699887+0000","last_peered":"2024-08-17T02:26:03.699887+0000","last_clean":"2024-08-17T02:26:03.699887+0000","last_became_active":"2024-08-17T02:26:03.699594+0000","last_became_peered":"2024-08-17T02:26:03.699594+0000","last_unstale":"2024-08-17T02:26:03.699887+0000","last_undegraded":"2024-08-17T02:26:03.699887+0000","last_fullsized":"2024-08-17T02:26:03.699887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:07.573229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708999+0000","last_change":"2024-08-17T02:26:03.701254+0000","last_active":"2024-08-17T02:26:03.708999+0000","last_peered":"2024-08-17T02:26:03.708999+0000","last_clean":"2024-08-17T02:26:03.708999+0000","last_became_active":"2024-08-17T02:26:03.700989+0000","last_became_peered":"2024-08-17T02:26:03.700989+0000","last_unstale":"2024-08-17T02:26:03.708999+0000","last_undegraded":"2024-08-17T02:26:03.708999+0000","last_fullsized":"2024-08-17T02:26:03.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683122+0000","last_change":"2024-08-17T02:26:03.680779+0000","last_active":"2024-08-17T02:26:03.683122+0000","last_peered":"2024-08-17T02:26:03.683122+0000","last_clean":"2024-08-17T02:26:03.683122+0000","last_became_active":"2024-08-17T02:26:03.678795+0000","last_became_peered":"2024-08-17T02:26:03.678795+0000","last_unstale":"2024-08-17T02:26:03.683122+0000","last_undegraded":"2024-08-17T02:26:03.683122+0000","last_fullsized":"2024-08-17T02:26:03.683122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700633+0000","last_change":"2024-08-17T02:26:03.700633+0000","last_active":"2024-08-17T02:26:03.700633+0000","last_peered":"2024-08-17T02:26:03.700633+0000","last_clean":"2024-08-17T02:26:03.700633+0000","last_became_active":"2024-08-17T02:26:03.700302+0000","last_became_peered":"2024-08-17T02:26:03.700302+0000","last_unstale":"2024-08-17T02:26:03.700633+0000","last_undegraded":"2024-08-17T02:26:03.700633+0000","last_fullsized":"2024-08-17T02:26:03.700633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696556+0000","last_change":"2024-08-17T02:26:03.696556+0000","last_active":"2024-08-17T02:26:03.696556+0000","last_peered":"2024-08-17T02:26:03.696556+0000","last_clean":"2024-08-17T02:26:03.696556+0000","last_became_active":"2024-08-17T02:26:03.696283+0000","last_became_peered":"2024-08-17T02:26:03.696283+0000","last_unstale":"2024-08-17T02:26:03.696556+0000","last_undegraded":"2024-08-17T02:26:03.696556+0000","last_fullsized":"2024-08-17T02:26:03.696556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711711+0000","last_change":"2024-08-17T02:26:03.711711+0000","last_active":"2024-08-17T02:26:03.711711+0000","last_peered":"2024-08-17T02:26:03.711711+0000","last_clean":"2024-08-17T02:26:03.711711+0000","last_became_active":"2024-08-17T02:26:03.711488+0000","last_became_peered":"2024-08-17T02:26:03.711488+0000","last_unstale":"2024-08-17T02:26:03.711711+0000","last_undegraded":"2024-08-17T02:26:03.711711+0000","last_fullsized":"2024-08-17T02:26:03.711711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697674+0000","last_change":"2024-08-17T02:26:03.697674+0000","last_active":"2024-08-17T02:26:03.697674+0000","last_peered":"2024-08-17T02:26:03.697674+0000","last_clean":"2024-08-17T02:26:03.697674+0000","last_became_active":"2024-08-17T02:26:03.694701+0000","last_became_peered":"2024-08-17T02:26:03.694701+0000","last_unstale":"2024-08-17T02:26:03.697674+0000","last_undegraded":"2024-08-17T02:26:03.697674+0000","last_fullsized":"2024-08-17T02:26:03.697674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708484+0000","last_change":"2024-08-17T02:26:03.700361+0000","last_active":"2024-08-17T02:26:03.708484+0000","last_peered":"2024-08-17T02:26:03.708484+0000","last_clean":"2024-08-17T02:26:03.708484+0000","last_became_active":"2024-08-17T02:26:03.691498+0000","last_became_peered":"2024-08-17T02:26:03.691498+0000","last_unstale":"2024-08-17T02:26:03.708484+0000","last_undegraded":"2024-08-17T02:26:03.708484+0000","last_fullsized":"2024-08-17T02:26:03.708484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.703171+0000","last_change":"2024-08-17T02:26:03.703171+0000","last_active":"2024-08-17T02:26:03.703171+0000","last_peered":"2024-08-17T02:26:03.703171+0000","last_clean":"2024-08-17T02:26:03.703171+0000","last_became_active":"2024-08-17T02:26:03.701780+0000","last_became_peered":"2024-08-17T02:26:03.701780+0000","last_unstale":"2024-08-17T02:26:03.703171+0000","last_undegraded":"2024-08-17T02:26:03.703171+0000","last_fullsized":"2024-08-17T02:26:03.703171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.689568+0000","last_change":"2024-08-17T02:26:03.684338+0000","last_active":"2024-08-17T02:26:03.689568+0000","last_peered":"2024-08-17T02:26:03.689568+0000","last_clean":"2024-08-17T02:26:03.689568+0000","last_became_active":"2024-08-17T02:26:03.683895+0000","last_became_peered":"2024-08-17T02:26:03.683895+0000","last_unstale":"2024-08-17T02:26:03.689568+0000","last_undegraded":"2024-08-17T02:26:03.689568+0000","last_fullsized":"2024-08-17T02:26:03.689568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708118+0000","last_change":"2024-08-17T02:26:03.708118+0000","last_active":"2024-08-17T02:26:03.708118+0000","last_peered":"2024-08-17T02:26:03.708118+0000","last_clean":"2024-08-17T02:26:03.708118+0000","last_became_active":"2024-08-17T02:26:03.707028+0000","last_became_peered":"2024-08-17T02:26:03.707028+0000","last_unstale":"2024-08-17T02:26:03.708118+0000","last_undegraded":"2024-08-17T02:26:03.708118+0000","last_fullsized":"2024-08-17T02:26:03.708118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701029+0000","last_change":"2024-08-17T02:26:03.698278+0000","last_active":"2024-08-17T02:26:03.701029+0000","last_peered":"2024-08-17T02:26:03.701029+0000","last_clean":"2024-08-17T02:26:03.701029+0000","last_became_active":"2024-08-17T02:26:03.698031+0000","last_became_peered":"2024-08-17T02:26:03.698031+0000","last_unstale":"2024-08-17T02:26:03.701029+0000","last_undegraded":"2024-08-17T02:26:03.701029+0000","last_fullsized":"2024-08-17T02:26:03.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.694710+0000","last_change":"2024-08-17T02:26:03.694710+0000","last_active":"2024-08-17T02:26:03.694710+0000","last_peered":"2024-08-17T02:26:03.694710+0000","last_clean":"2024-08-17T02:26:03.694710+0000","last_became_active":"2024-08-17T02:26:03.693342+0000","last_became_peered":"2024-08-17T02:26:03.693342+0000","last_unstale":"2024-08-17T02:26:03.694710+0000","last_undegraded":"2024-08-17T02:26:03.694710+0000","last_fullsized":"2024-08-17T02:26:03.694710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701083+0000","last_change":"2024-08-17T02:26:03.698485+0000","last_active":"2024-08-17T02:26:03.701083+0000","last_peered":"2024-08-17T02:26:03.701083+0000","last_clean":"2024-08-17T02:26:03.701083+0000","last_became_active":"2024-08-17T02:26:03.698183+0000","last_became_peered":"2024-08-17T02:26:03.698183+0000","last_unstale":"2024-08-17T02:26:03.701083+0000","last_undegraded":"2024-08-17T02:26:03.701083+0000","last_fullsized":"2024-08-17T02:26:03.701083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707593+0000","last_change":"2024-08-17T02:26:03.707593+0000","last_active":"2024-08-17T02:26:03.707593+0000","last_peered":"2024-08-17T02:26:03.707593+0000","last_clean":"2024-08-17T02:26:03.707593+0000","last_became_active":"2024-08-17T02:26:03.707341+0000","last_became_peered":"2024-08-17T02:26:03.707341+0000","last_unstale":"2024-08-17T02:26:03.707593+0000","last_undegraded":"2024-08-17T02:26:03.707593+0000","last_fullsized":"2024-08-17T02:26:03.707593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.693165+0000","last_change":"2024-08-17T02:26:03.693165+0000","last_active":"2024-08-17T02:26:03.693165+0000","last_peered":"2024-08-17T02:26:03.693165+0000","last_clean":"2024-08-17T02:26:03.693165+0000","last_became_active":"2024-08-17T02:26:03.692908+0000","last_became_peered":"2024-08-17T02:26:03.692908+0000","last_unstale":"2024-08-17T02:26:03.693165+0000","last_undegraded":"2024-08-17T02:26:03.693165+0000","last_fullsized":"2024-08-17T02:26:03.693165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709161+0000","last_change":"2024-08-17T02:26:03.704953+0000","last_active":"2024-08-17T02:26:03.709161+0000","last_peered":"2024-08-17T02:26:03.709161+0000","last_clean":"2024-08-17T02:26:03.709161+0000","last_became_active":"2024-08-17T02:26:03.704774+0000","last_became_peered":"2024-08-17T02:26:03.704774+0000","last_unstale":"2024-08-17T02:26:03.709161+0000","last_undegraded":"2024-08-17T02:26:03.709161+0000","last_fullsized":"2024-08-17T02:26:03.709161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711737+0000","last_change":"2024-08-17T02:26:03.710637+0000","last_active":"2024-08-17T02:26:03.711737+0000","last_peered":"2024-08-17T02:26:03.711737+0000","last_clean":"2024-08-17T02:26:03.711737+0000","last_became_active":"2024-08-17T02:26:03.710268+0000","last_became_peered":"2024-08-17T02:26:03.710268+0000","last_unstale":"2024-08-17T02:26:03.711737+0000","last_undegraded":"2024-08-17T02:26:03.711737+0000","last_fullsized":"2024-08-17T02:26:03.711737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707884+0000","last_change":"2024-08-17T02:26:03.707884+0000","last_active":"2024-08-17T02:26:03.707884+0000","last_peered":"2024-08-17T02:26:03.707884+0000","last_clean":"2024-08-17T02:26:03.707884+0000","last_became_active":"2024-08-17T02:26:03.706445+0000","last_became_peered":"2024-08-17T02:26:03.706445+0000","last_unstale":"2024-08-17T02:26:03.707884+0000","last_undegraded":"2024-08-17T02:26:03.707884+0000","last_fullsized":"2024-08-17T02:26:03.707884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695921+0000","last_change":"2024-08-17T02:26:03.695921+0000","last_active":"2024-08-17T02:26:03.695921+0000","last_peered":"2024-08-17T02:26:03.695921+0000","last_clean":"2024-08-17T02:26:03.695921+0000","last_became_active":"2024-08-17T02:26:03.695608+0000","last_became_peered":"2024-08-17T02:26:03.695608+0000","last_unstale":"2024-08-17T02:26:03.695921+0000","last_undegraded":"2024-08-17T02:26:03.695921+0000","last_fullsized":"2024-08-17T02:26:03.695921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697117+0000","last_change":"2024-08-17T02:26:03.697117+0000","last_active":"2024-08-17T02:26:03.697117+0000","last_peered":"2024-08-17T02:26:03.697117+0000","last_clean":"2024-08-17T02:26:03.697117+0000","last_became_active":"2024-08-17T02:26:03.696545+0000","last_became_peered":"2024-08-17T02:26:03.696545+0000","last_unstale":"2024-08-17T02:26:03.697117+0000","last_undegraded":"2024-08-17T02:26:03.697117+0000","last_fullsized":"2024-08-17T02:26:03.697117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.692906+0000","last_change":"2024-08-17T02:26:03.692906+0000","last_active":"2024-08-17T02:26:03.692906+0000","last_peered":"2024-08-17T02:26:03.692906+0000","last_clean":"2024-08-17T02:26:03.692906+0000","last_became_active":"2024-08-17T02:26:03.690376+0000","last_became_peered":"2024-08-17T02:26:03.690376+0000","last_unstale":"2024-08-17T02:26:03.692906+0000","last_undegraded":"2024-08-17T02:26:03.692906+0000","last_fullsized":"2024-08-17T02:26:03.692906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708921+0000","last_change":"2024-08-17T02:26:02.683268+0000","last_active":"2024-08-17T02:26:03.708921+0000","last_peered":"2024-08-17T02:26:03.708921+0000","last_clean":"2024-08-17T02:26:03.708921+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.708921+0000","last_undegraded":"2024-08-17T02:26:03.708921+0000","last_fullsized":"2024-08-17T02:26:03.708921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700431+0000","last_change":"2024-08-17T02:26:03.696347+0000","last_active":"2024-08-17T02:26:03.700431+0000","last_peered":"2024-08-17T02:26:03.700431+0000","last_clean":"2024-08-17T02:26:03.700431+0000","last_became_active":"2024-08-17T02:26:03.696090+0000","last_became_peered":"2024-08-17T02:26:03.696090+0000","last_unstale":"2024-08-17T02:26:03.700431+0000","last_undegraded":"2024-08-17T02:26:03.700431+0000","last_fullsized":"2024-08-17T02:26:03.700431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702819+0000","last_change":"2024-08-17T02:26:02.692755+0000","last_active":"2024-08-17T02:26:03.702819+0000","last_peered":"2024-08-17T02:26:03.702819+0000","last_clean":"2024-08-17T02:26:03.702819+0000","last_became_active":"2024-08-17T02:26:02.692433+0000","last_became_peered":"2024-08-17T02:26:02.692433+0000","last_unstale":"2024-08-17T02:26:03.702819+0000","last_undegraded":"2024-08-17T02:26:03.702819+0000","last_fullsized":"2024-08-17T02:26:03.702819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.690965+0000","last_change":"2024-08-17T02:26:02.690367+0000","last_active":"2024-08-17T02:26:03.690965+0000","last_peered":"2024-08-17T02:26:03.690965+0000","last_clean":"2024-08-17T02:26:03.690965+0000","last_became_active":"2024-08-17T02:26:02.686604+0000","last_became_peered":"2024-08-17T02:26:02.686604+0000","last_unstale":"2024-08-17T02:26:03.690965+0000","last_undegraded":"2024-08-17T02:26:03.690965+0000","last_fullsized":"2024-08-17T02:26:03.690965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700829+0000","last_change":"2024-08-17T02:26:03.694153+0000","last_active":"2024-08-17T02:26:03.700829+0000","last_peered":"2024-08-17T02:26:03.700829+0000","last_clean":"2024-08-17T02:26:03.700829+0000","last_became_active":"2024-08-17T02:26:03.693219+0000","last_became_peered":"2024-08-17T02:26:03.693219+0000","last_unstale":"2024-08-17T02:26:03.700829+0000","last_undegraded":"2024-08-17T02:26:03.700829+0000","last_fullsized":"2024-08-17T02:26:03.700829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702251+0000","last_change":"2024-08-17T02:26:02.699358+0000","last_active":"2024-08-17T02:26:02.702251+0000","last_peered":"2024-08-17T02:26:02.702251+0000","last_clean":"2024-08-17T02:26:02.702251+0000","last_became_active":"2024-08-17T02:26:02.699049+0000","last_became_peered":"2024-08-17T02:26:02.699049+0000","last_unstale":"2024-08-17T02:26:02.702251+0000","last_undegraded":"2024-08-17T02:26:02.702251+0000","last_fullsized":"2024-08-17T02:26:02.702251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696889+0000","last_change":"2024-08-17T02:26:03.696889+0000","last_active":"2024-08-17T02:26:03.696889+0000","last_peered":"2024-08-17T02:26:03.696889+0000","last_clean":"2024-08-17T02:26:03.696889+0000","last_became_active":"2024-08-17T02:26:03.696643+0000","last_became_peered":"2024-08-17T02:26:03.696643+0000","last_unstale":"2024-08-17T02:26:03.696889+0000","last_undegraded":"2024-08-17T02:26:03.696889+0000","last_fullsized":"2024-08-17T02:26:03.696889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.704929+0000","last_change":"2024-08-17T02:26:02.698402+0000","last_active":"2024-08-17T02:26:02.704929+0000","last_peered":"2024-08-17T02:26:02.704929+0000","last_clean":"2024-08-17T02:26:02.704929+0000","last_became_active":"2024-08-17T02:26:02.698127+0000","last_became_peered":"2024-08-17T02:26:02.698127+0000","last_unstale":"2024-08-17T02:26:02.704929+0000","last_undegraded":"2024-08-17T02:26:02.704929+0000","last_fullsized":"2024-08-17T02:26:02.704929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706523+0000","last_change":"2024-08-17T02:26:03.706523+0000","last_active":"2024-08-17T02:26:03.706523+0000","last_peered":"2024-08-17T02:26:03.706523+0000","last_clean":"2024-08-17T02:26:03.706523+0000","last_became_active":"2024-08-17T02:26:03.706259+0000","last_became_peered":"2024-08-17T02:26:03.706259+0000","last_unstale":"2024-08-17T02:26:03.706523+0000","last_undegraded":"2024-08-17T02:26:03.706523+0000","last_fullsized":"2024-08-17T02:26:03.706523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702347+0000","last_change":"2024-08-17T02:26:02.697853+0000","last_active":"2024-08-17T02:26:02.702347+0000","last_peered":"2024-08-17T02:26:02.702347+0000","last_clean":"2024-08-17T02:26:02.702347+0000","last_became_active":"2024-08-17T02:26:02.697333+0000","last_became_peered":"2024-08-17T02:26:02.697333+0000","last_unstale":"2024-08-17T02:26:02.702347+0000","last_undegraded":"2024-08-17T02:26:02.702347+0000","last_fullsized":"2024-08-17T02:26:02.702347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700464+0000","last_change":"2024-08-17T02:26:03.697416+0000","last_active":"2024-08-17T02:26:03.700464+0000","last_peered":"2024-08-17T02:26:03.700464+0000","last_clean":"2024-08-17T02:26:03.700464+0000","last_became_active":"2024-08-17T02:26:03.697117+0000","last_became_peered":"2024-08-17T02:26:03.697117+0000","last_unstale":"2024-08-17T02:26:03.700464+0000","last_undegraded":"2024-08-17T02:26:03.700464+0000","last_fullsized":"2024-08-17T02:26:03.700464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.703978+0000","last_change":"2024-08-17T02:26:02.698299+0000","last_active":"2024-08-17T02:26:03.703978+0000","last_peered":"2024-08-17T02:26:03.703978+0000","last_clean":"2024-08-17T02:26:03.703978+0000","last_became_active":"2024-08-17T02:26:02.698048+0000","last_became_peered":"2024-08-17T02:26:02.698048+0000","last_unstale":"2024-08-17T02:26:03.703978+0000","last_undegraded":"2024-08-17T02:26:03.703978+0000","last_fullsized":"2024-08-17T02:26:03.703978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711973+0000","last_change":"2024-08-17T02:26:03.711973+0000","last_active":"2024-08-17T02:26:03.711973+0000","last_peered":"2024-08-17T02:26:03.711973+0000","last_clean":"2024-08-17T02:26:03.711973+0000","last_became_active":"2024-08-17T02:26:03.709989+0000","last_became_peered":"2024-08-17T02:26:03.709989+0000","last_unstale":"2024-08-17T02:26:03.711973+0000","last_undegraded":"2024-08-17T02:26:03.711973+0000","last_fullsized":"2024-08-17T02:26:03.711973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713083+0000","last_change":"2024-08-17T02:26:02.693614+0000","last_active":"2024-08-17T02:26:03.713083+0000","last_peered":"2024-08-17T02:26:03.713083+0000","last_clean":"2024-08-17T02:26:03.713083+0000","last_became_active":"2024-08-17T02:26:02.691439+0000","last_became_peered":"2024-08-17T02:26:02.691439+0000","last_unstale":"2024-08-17T02:26:03.713083+0000","last_undegraded":"2024-08-17T02:26:03.713083+0000","last_fullsized":"2024-08-17T02:26:03.713083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708522+0000","last_change":"2024-08-17T02:26:03.700840+0000","last_active":"2024-08-17T02:26:03.708522+0000","last_peered":"2024-08-17T02:26:03.708522+0000","last_clean":"2024-08-17T02:26:03.708522+0000","last_became_active":"2024-08-17T02:26:03.691916+0000","last_became_peered":"2024-08-17T02:26:03.691916+0000","last_unstale":"2024-08-17T02:26:03.708522+0000","last_undegraded":"2024-08-17T02:26:03.708522+0000","last_fullsized":"2024-08-17T02:26:03.708522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695917+0000","last_change":"2024-08-17T02:26:02.693440+0000","last_active":"2024-08-17T02:26:03.695917+0000","last_peered":"2024-08-17T02:26:03.695917+0000","last_clean":"2024-08-17T02:26:03.695917+0000","last_became_active":"2024-08-17T02:26:02.693121+0000","last_became_peered":"2024-08-17T02:26:02.693121+0000","last_unstale":"2024-08-17T02:26:03.695917+0000","last_undegraded":"2024-08-17T02:26:03.695917+0000","last_fullsized":"2024-08-17T02:26:03.695917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:11.874973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700196+0000","last_change":"2024-08-17T02:26:03.695504+0000","last_active":"2024-08-17T02:26:03.700196+0000","last_peered":"2024-08-17T02:26:03.700196+0000","last_clean":"2024-08-17T02:26:03.700196+0000","last_became_active":"2024-08-17T02:26:03.694472+0000","last_became_peered":"2024-08-17T02:26:03.694472+0000","last_unstale":"2024-08-17T02:26:03.700196+0000","last_undegraded":"2024-08-17T02:26:03.700196+0000","last_fullsized":"2024-08-17T02:26:03.700196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:16.565066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702155+0000","last_change":"2024-08-17T02:26:02.698302+0000","last_active":"2024-08-17T02:26:02.702155+0000","last_peered":"2024-08-17T02:26:02.702155+0000","last_clean":"2024-08-17T02:26:02.702155+0000","last_became_active":"2024-08-17T02:26:02.698027+0000","last_became_peered":"2024-08-17T02:26:02.698027+0000","last_unstale":"2024-08-17T02:26:02.702155+0000","last_undegraded":"2024-08-17T02:26:02.702155+0000","last_fullsized":"2024-08-17T02:26:02.702155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709234+0000","last_change":"2024-08-17T02:26:03.703475+0000","last_active":"2024-08-17T02:26:03.709234+0000","last_peered":"2024-08-17T02:26:03.709234+0000","last_clean":"2024-08-17T02:26:03.709234+0000","last_became_active":"2024-08-17T02:26:03.701071+0000","last_became_peered":"2024-08-17T02:26:03.701071+0000","last_unstale":"2024-08-17T02:26:03.709234+0000","last_undegraded":"2024-08-17T02:26:03.709234+0000","last_fullsized":"2024-08-17T02:26:03.709234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.694754+0000","last_change":"2024-08-17T02:26:02.693306+0000","last_active":"2024-08-17T02:26:02.694754+0000","last_peered":"2024-08-17T02:26:02.694754+0000","last_clean":"2024-08-17T02:26:02.694754+0000","last_became_active":"2024-08-17T02:26:02.692943+0000","last_became_peered":"2024-08-17T02:26:02.692943+0000","last_unstale":"2024-08-17T02:26:02.694754+0000","last_undegraded":"2024-08-17T02:26:02.694754+0000","last_fullsized":"2024-08-17T02:26:02.694754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696903+0000","last_change":"2024-08-17T02:26:03.696903+0000","last_active":"2024-08-17T02:26:03.696903+0000","last_peered":"2024-08-17T02:26:03.696903+0000","last_clean":"2024-08-17T02:26:03.696903+0000","last_became_active":"2024-08-17T02:26:03.696184+0000","last_became_peered":"2024-08-17T02:26:03.696184+0000","last_unstale":"2024-08-17T02:26:03.696903+0000","last_undegraded":"2024-08-17T02:26:03.696903+0000","last_fullsized":"2024-08-17T02:26:03.696903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705068+0000","last_change":"2024-08-17T02:26:02.686536+0000","last_active":"2024-08-17T02:26:03.705068+0000","last_peered":"2024-08-17T02:26:03.705068+0000","last_clean":"2024-08-17T02:26:03.705068+0000","last_became_active":"2024-08-17T02:26:02.686234+0000","last_became_peered":"2024-08-17T02:26:02.686234+0000","last_unstale":"2024-08-17T02:26:03.705068+0000","last_undegraded":"2024-08-17T02:26:03.705068+0000","last_fullsized":"2024-08-17T02:26:03.705068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710752+0000","last_change":"2024-08-17T02:26:03.705371+0000","last_active":"2024-08-17T02:26:03.710752+0000","last_peered":"2024-08-17T02:26:03.710752+0000","last_clean":"2024-08-17T02:26:03.710752+0000","last_became_active":"2024-08-17T02:26:03.703153+0000","last_became_peered":"2024-08-17T02:26:03.703153+0000","last_unstale":"2024-08-17T02:26:03.710752+0000","last_undegraded":"2024-08-17T02:26:03.710752+0000","last_fullsized":"2024-08-17T02:26:03.710752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.682337+0000","last_change":"2024-08-17T02:26:02.697624+0000","last_active":"2024-08-17T02:26:03.682337+0000","last_peered":"2024-08-17T02:26:03.682337+0000","last_clean":"2024-08-17T02:26:03.682337+0000","last_became_active":"2024-08-17T02:26:02.697417+0000","last_became_peered":"2024-08-17T02:26:02.697417+0000","last_unstale":"2024-08-17T02:26:03.682337+0000","last_undegraded":"2024-08-17T02:26:03.682337+0000","last_fullsized":"2024-08-17T02:26:03.682337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:09.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710177+0000","last_change":"2024-08-17T02:26:03.705614+0000","last_active":"2024-08-17T02:26:03.710177+0000","last_peered":"2024-08-17T02:26:03.710177+0000","last_clean":"2024-08-17T02:26:03.710177+0000","last_became_active":"2024-08-17T02:26:03.701211+0000","last_became_peered":"2024-08-17T02:26:03.701211+0000","last_unstale":"2024-08-17T02:26:03.710177+0000","last_undegraded":"2024-08-17T02:26:03.710177+0000","last_fullsized":"2024-08-17T02:26:03.710177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704765+0000","last_change":"2024-08-17T02:26:02.686432+0000","last_active":"2024-08-17T02:26:03.704765+0000","last_peered":"2024-08-17T02:26:03.704765+0000","last_clean":"2024-08-17T02:26:03.704765+0000","last_became_active":"2024-08-17T02:26:02.686122+0000","last_became_peered":"2024-08-17T02:26:02.686122+0000","last_unstale":"2024-08-17T02:26:03.704765+0000","last_undegraded":"2024-08-17T02:26:03.704765+0000","last_fullsized":"2024-08-17T02:26:03.704765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710286+0000","last_change":"2024-08-17T02:26:03.707361+0000","last_active":"2024-08-17T02:26:03.710286+0000","last_peered":"2024-08-17T02:26:03.710286+0000","last_clean":"2024-08-17T02:26:03.710286+0000","last_became_active":"2024-08-17T02:26:03.702988+0000","last_became_peered":"2024-08-17T02:26:03.702988+0000","last_unstale":"2024-08-17T02:26:03.710286+0000","last_undegraded":"2024-08-17T02:26:03.710286+0000","last_fullsized":"2024-08-17T02:26:03.710286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674987+0000","last_change":"2024-08-17T02:26:02.691873+0000","last_active":"2024-08-17T02:26:03.674987+0000","last_peered":"2024-08-17T02:26:03.674987+0000","last_clean":"2024-08-17T02:26:03.674987+0000","last_became_active":"2024-08-17T02:26:02.691585+0000","last_became_peered":"2024-08-17T02:26:02.691585+0000","last_unstale":"2024-08-17T02:26:03.674987+0000","last_undegraded":"2024-08-17T02:26:03.674987+0000","last_fullsized":"2024-08-17T02:26:03.674987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695043+0000","last_change":"2024-08-17T02:26:03.695043+0000","last_active":"2024-08-17T02:26:03.695043+0000","last_peered":"2024-08-17T02:26:03.695043+0000","last_clean":"2024-08-17T02:26:03.695043+0000","last_became_active":"2024-08-17T02:26:03.694187+0000","last_became_peered":"2024-08-17T02:26:03.694187+0000","last_unstale":"2024-08-17T02:26:03.695043+0000","last_undegraded":"2024-08-17T02:26:03.695043+0000","last_fullsized":"2024-08-17T02:26:03.695043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.700095+0000","last_change":"2024-08-17T02:26:02.698483+0000","last_active":"2024-08-17T02:26:02.700095+0000","last_peered":"2024-08-17T02:26:02.700095+0000","last_clean":"2024-08-17T02:26:02.700095+0000","last_became_active":"2024-08-17T02:26:02.698229+0000","last_became_peered":"2024-08-17T02:26:02.698229+0000","last_unstale":"2024-08-17T02:26:02.700095+0000","last_undegraded":"2024-08-17T02:26:02.700095+0000","last_fullsized":"2024-08-17T02:26:02.700095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710151+0000","last_change":"2024-08-17T02:26:03.703895+0000","last_active":"2024-08-17T02:26:03.710151+0000","last_peered":"2024-08-17T02:26:03.710151+0000","last_clean":"2024-08-17T02:26:03.710151+0000","last_became_active":"2024-08-17T02:26:03.703616+0000","last_became_peered":"2024-08-17T02:26:03.703616+0000","last_unstale":"2024-08-17T02:26:03.710151+0000","last_undegraded":"2024-08-17T02:26:03.710151+0000","last_fullsized":"2024-08-17T02:26:03.710151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:46.487161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674444+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:03.674444+0000","last_peered":"2024-08-17T02:26:03.674444+0000","last_clean":"2024-08-17T02:26:03.674444+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:03.674444+0000","last_undegraded":"2024-08-17T02:26:03.674444+0000","last_fullsized":"2024-08-17T02:26:03.674444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.697360+0000","last_change":"2024-08-17T02:26:02.691288+0000","last_active":"2024-08-17T02:26:02.697360+0000","last_peered":"2024-08-17T02:26:02.697360+0000","last_clean":"2024-08-17T02:26:02.697360+0000","last_became_active":"2024-08-17T02:26:02.691023+0000","last_became_peered":"2024-08-17T02:26:02.691023+0000","last_unstale":"2024-08-17T02:26:02.697360+0000","last_undegraded":"2024-08-17T02:26:02.697360+0000","last_fullsized":"2024-08-17T02:26:02.697360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707843+0000","last_change":"2024-08-17T02:26:03.705291+0000","last_active":"2024-08-17T02:26:03.707843+0000","last_peered":"2024-08-17T02:26:03.707843+0000","last_clean":"2024-08-17T02:26:03.707843+0000","last_became_active":"2024-08-17T02:26:03.704669+0000","last_became_peered":"2024-08-17T02:26:03.704669+0000","last_unstale":"2024-08-17T02:26:03.707843+0000","last_undegraded":"2024-08-17T02:26:03.707843+0000","last_fullsized":"2024-08-17T02:26:03.707843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674432+0000","last_change":"2024-08-17T02:26:02.683352+0000","last_active":"2024-08-17T02:26:03.674432+0000","last_peered":"2024-08-17T02:26:03.674432+0000","last_clean":"2024-08-17T02:26:03.674432+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.674432+0000","last_undegraded":"2024-08-17T02:26:03.674432+0000","last_fullsized":"2024-08-17T02:26:03.674432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700402+0000","last_change":"2024-08-17T02:26:03.695517+0000","last_active":"2024-08-17T02:26:03.700402+0000","last_peered":"2024-08-17T02:26:03.700402+0000","last_clean":"2024-08-17T02:26:03.700402+0000","last_became_active":"2024-08-17T02:26:03.694448+0000","last_became_peered":"2024-08-17T02:26:03.694448+0000","last_unstale":"2024-08-17T02:26:03.700402+0000","last_undegraded":"2024-08-17T02:26:03.700402+0000","last_fullsized":"2024-08-17T02:26:03.700402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.689209+0000","last_change":"2024-08-17T02:26:02.681358+0000","last_active":"2024-08-17T02:26:02.689209+0000","last_peered":"2024-08-17T02:26:02.689209+0000","last_clean":"2024-08-17T02:26:02.689209+0000","last_became_active":"2024-08-17T02:26:02.681132+0000","last_became_peered":"2024-08-17T02:26:02.681132+0000","last_unstale":"2024-08-17T02:26:02.689209+0000","last_undegraded":"2024-08-17T02:26:02.689209+0000","last_fullsized":"2024-08-17T02:26:02.689209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.685671+0000","last_change":"2024-08-17T02:26:03.685671+0000","last_active":"2024-08-17T02:26:03.685671+0000","last_peered":"2024-08-17T02:26:03.685671+0000","last_clean":"2024-08-17T02:26:03.685671+0000","last_became_active":"2024-08-17T02:26:03.685342+0000","last_became_peered":"2024-08-17T02:26:03.685342+0000","last_unstale":"2024-08-17T02:26:03.685671+0000","last_undegraded":"2024-08-17T02:26:03.685671+0000","last_fullsized":"2024-08-17T02:26:03.685671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.702117+0000","last_change":"2024-08-17T02:26:02.697313+0000","last_active":"2024-08-17T02:26:02.702117+0000","last_peered":"2024-08-17T02:26:02.702117+0000","last_clean":"2024-08-17T02:26:02.702117+0000","last_became_active":"2024-08-17T02:26:02.693931+0000","last_became_peered":"2024-08-17T02:26:02.693931+0000","last_unstale":"2024-08-17T02:26:02.702117+0000","last_undegraded":"2024-08-17T02:26:02.702117+0000","last_fullsized":"2024-08-17T02:26:02.702117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.698206+0000","last_change":"2024-08-17T02:26:03.698206+0000","last_active":"2024-08-17T02:26:03.698206+0000","last_peered":"2024-08-17T02:26:03.698206+0000","last_clean":"2024-08-17T02:26:03.698206+0000","last_became_active":"2024-08-17T02:26:03.696941+0000","last_became_peered":"2024-08-17T02:26:03.696941+0000","last_unstale":"2024-08-17T02:26:03.698206+0000","last_undegraded":"2024-08-17T02:26:03.698206+0000","last_fullsized":"2024-08-17T02:26:03.698206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:32.247498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.693908+0000","last_change":"2024-08-17T02:26:02.689793+0000","last_active":"2024-08-17T02:26:02.693908+0000","last_peered":"2024-08-17T02:26:02.693908+0000","last_clean":"2024-08-17T02:26:02.693908+0000","last_became_active":"2024-08-17T02:26:02.689266+0000","last_became_peered":"2024-08-17T02:26:02.689266+0000","last_unstale":"2024-08-17T02:26:02.693908+0000","last_undegraded":"2024-08-17T02:26:02.693908+0000","last_fullsized":"2024-08-17T02:26:02.693908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696041+0000","last_change":"2024-08-17T02:26:03.696041+0000","last_active":"2024-08-17T02:26:03.696041+0000","last_peered":"2024-08-17T02:26:03.696041+0000","last_clean":"2024-08-17T02:26:03.696041+0000","last_became_active":"2024-08-17T02:26:03.695675+0000","last_became_peered":"2024-08-17T02:26:03.695675+0000","last_unstale":"2024-08-17T02:26:03.696041+0000","last_undegraded":"2024-08-17T02:26:03.696041+0000","last_fullsized":"2024-08-17T02:26:03.696041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.676108+0000","last_change":"2024-08-17T02:26:02.691075+0000","last_active":"2024-08-17T02:26:03.676108+0000","last_peered":"2024-08-17T02:26:03.676108+0000","last_clean":"2024-08-17T02:26:03.676108+0000","last_became_active":"2024-08-17T02:26:02.690601+0000","last_became_peered":"2024-08-17T02:26:02.690601+0000","last_unstale":"2024-08-17T02:26:03.676108+0000","last_undegraded":"2024-08-17T02:26:03.676108+0000","last_fullsized":"2024-08-17T02:26:03.676108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:15.556656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686234+0000","last_change":"2024-08-17T02:26:03.686234+0000","last_active":"2024-08-17T02:26:03.686234+0000","last_peered":"2024-08-17T02:26:03.686234+0000","last_clean":"2024-08-17T02:26:03.686234+0000","last_became_active":"2024-08-17T02:26:03.685409+0000","last_became_peered":"2024-08-17T02:26:03.685409+0000","last_unstale":"2024-08-17T02:26:03.686234+0000","last_undegraded":"2024-08-17T02:26:03.686234+0000","last_fullsized":"2024-08-17T02:26:03.686234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.697136+0000","last_change":"2024-08-17T02:26:02.694328+0000","last_active":"2024-08-17T02:26:02.697136+0000","last_peered":"2024-08-17T02:26:02.697136+0000","last_clean":"2024-08-17T02:26:02.697136+0000","last_became_active":"2024-08-17T02:26:02.693978+0000","last_became_peered":"2024-08-17T02:26:02.693978+0000","last_unstale":"2024-08-17T02:26:02.697136+0000","last_undegraded":"2024-08-17T02:26:02.697136+0000","last_fullsized":"2024-08-17T02:26:02.697136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710044+0000","last_change":"2024-08-17T02:26:03.708726+0000","last_active":"2024-08-17T02:26:03.710044+0000","last_peered":"2024-08-17T02:26:03.710044+0000","last_clean":"2024-08-17T02:26:03.710044+0000","last_became_active":"2024-08-17T02:26:03.708552+0000","last_became_peered":"2024-08-17T02:26:03.708552+0000","last_unstale":"2024-08-17T02:26:03.710044+0000","last_undegraded":"2024-08-17T02:26:03.710044+0000","last_fullsized":"2024-08-17T02:26:03.710044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710926+0000","last_change":"2024-08-17T02:26:02.700098+0000","last_active":"2024-08-17T02:26:03.710926+0000","last_peered":"2024-08-17T02:26:03.710926+0000","last_clean":"2024-08-17T02:26:03.710926+0000","last_became_active":"2024-08-17T02:26:02.699846+0000","last_became_peered":"2024-08-17T02:26:02.699846+0000","last_unstale":"2024-08-17T02:26:03.710926+0000","last_undegraded":"2024-08-17T02:26:03.710926+0000","last_fullsized":"2024-08-17T02:26:03.710926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.681734+0000","last_change":"2024-08-17T02:26:03.678930+0000","last_active":"2024-08-17T02:26:03.681734+0000","last_peered":"2024-08-17T02:26:03.681734+0000","last_clean":"2024-08-17T02:26:03.681734+0000","last_became_active":"2024-08-17T02:26:03.678664+0000","last_became_peered":"2024-08-17T02:26:03.678664+0000","last_unstale":"2024-08-17T02:26:03.681734+0000","last_undegraded":"2024-08-17T02:26:03.681734+0000","last_fullsized":"2024-08-17T02:26:03.681734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674335+0000","last_change":"2024-08-17T02:26:02.691047+0000","last_active":"2024-08-17T02:26:03.674335+0000","last_peered":"2024-08-17T02:26:03.674335+0000","last_clean":"2024-08-17T02:26:03.674335+0000","last_became_active":"2024-08-17T02:26:02.690711+0000","last_became_peered":"2024-08-17T02:26:02.690711+0000","last_unstale":"2024-08-17T02:26:03.674335+0000","last_undegraded":"2024-08-17T02:26:03.674335+0000","last_fullsized":"2024-08-17T02:26:03.674335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:31.239087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.696174+0000","last_change":"2024-08-17T02:26:03.696174+0000","last_active":"2024-08-17T02:26:03.696174+0000","last_peered":"2024-08-17T02:26:03.696174+0000","last_clean":"2024-08-17T02:26:03.696174+0000","last_became_active":"2024-08-17T02:26:03.695719+0000","last_became_peered":"2024-08-17T02:26:03.695719+0000","last_unstale":"2024-08-17T02:26:03.696174+0000","last_undegraded":"2024-08-17T02:26:03.696174+0000","last_fullsized":"2024-08-17T02:26:03.696174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:47.054753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.687129+0000","last_change":"2024-08-17T02:26:02.683782+0000","last_active":"2024-08-17T02:26:02.687129+0000","last_peered":"2024-08-17T02:26:02.687129+0000","last_clean":"2024-08-17T02:26:02.687129+0000","last_became_active":"2024-08-17T02:26:02.681787+0000","last_became_peered":"2024-08-17T02:26:02.681787+0000","last_unstale":"2024-08-17T02:26:02.687129+0000","last_undegraded":"2024-08-17T02:26:02.687129+0000","last_fullsized":"2024-08-17T02:26:02.687129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700808+0000","last_change":"2024-08-17T02:26:03.692440+0000","last_active":"2024-08-17T02:26:03.700808+0000","last_peered":"2024-08-17T02:26:03.700808+0000","last_clean":"2024-08-17T02:26:03.700808+0000","last_became_active":"2024-08-17T02:26:03.691740+0000","last_became_peered":"2024-08-17T02:26:03.691740+0000","last_unstale":"2024-08-17T02:26:03.700808+0000","last_undegraded":"2024-08-17T02:26:03.700808+0000","last_fullsized":"2024-08-17T02:26:03.700808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:26:02.686674+0000","last_change":"2024-08-17T02:26:02.682746+0000","last_active":"2024-08-17T02:26:02.686674+0000","last_peered":"2024-08-17T02:26:02.686674+0000","last_clean":"2024-08-17T02:26:02.686674+0000","last_became_active":"2024-08-17T02:26:02.677985+0000","last_became_peered":"2024-08-17T02:26:02.677985+0000","last_unstale":"2024-08-17T02:26:02.686674+0000","last_undegraded":"2024-08-17T02:26:02.686674+0000","last_fullsized":"2024-08-17T02:26:02.686674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701339+0000","last_change":"2024-08-17T02:26:03.694939+0000","last_active":"2024-08-17T02:26:03.701339+0000","last_peered":"2024-08-17T02:26:03.701339+0000","last_clean":"2024-08-17T02:26:03.701339+0000","last_became_active":"2024-08-17T02:26:03.694230+0000","last_became_peered":"2024-08-17T02:26:03.694230+0000","last_unstale":"2024-08-17T02:26:03.701339+0000","last_undegraded":"2024-08-17T02:26:03.701339+0000","last_fullsized":"2024-08-17T02:26:03.701339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713165+0000","last_change":"2024-08-17T02:26:02.695510+0000","last_active":"2024-08-17T02:26:03.713165+0000","last_peered":"2024-08-17T02:26:03.713165+0000","last_clean":"2024-08-17T02:26:03.713165+0000","last_became_active":"2024-08-17T02:26:02.695315+0000","last_became_peered":"2024-08-17T02:26:02.695315+0000","last_unstale":"2024-08-17T02:26:03.713165+0000","last_undegraded":"2024-08-17T02:26:03.713165+0000","last_fullsized":"2024-08-17T02:26:03.713165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704528+0000","last_change":"2024-08-17T02:26:03.704528+0000","last_active":"2024-08-17T02:26:03.704528+0000","last_peered":"2024-08-17T02:26:03.704528+0000","last_clean":"2024-08-17T02:26:03.704528+0000","last_became_active":"2024-08-17T02:26:03.693099+0000","last_became_peered":"2024-08-17T02:26:03.693099+0000","last_unstale":"2024-08-17T02:26:03.704528+0000","last_undegraded":"2024-08-17T02:26:03.704528+0000","last_fullsized":"2024-08-17T02:26:03.704528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699962+0000","last_change":"2024-08-17T02:26:03.699962+0000","last_active":"2024-08-17T02:26:03.699962+0000","last_peered":"2024-08-17T02:26:03.699962+0000","last_clean":"2024-08-17T02:26:03.699962+0000","last_became_active":"2024-08-17T02:26:03.699542+0000","last_became_peered":"2024-08-17T02:26:03.699542+0000","last_unstale":"2024-08-17T02:26:03.699962+0000","last_undegraded":"2024-08-17T02:26:03.699962+0000","last_fullsized":"2024-08-17T02:26:03.699962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713543+0000","last_change":"2024-08-17T02:26:02.699093+0000","last_active":"2024-08-17T02:26:03.713543+0000","last_peered":"2024-08-17T02:26:03.713543+0000","last_clean":"2024-08-17T02:26:03.713543+0000","last_became_active":"2024-08-17T02:26:02.698750+0000","last_became_peered":"2024-08-17T02:26:02.698750+0000","last_unstale":"2024-08-17T02:26:03.713543+0000","last_undegraded":"2024-08-17T02:26:03.713543+0000","last_fullsized":"2024-08-17T02:26:03.713543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695207+0000","last_change":"2024-08-17T02:26:03.695207+0000","last_active":"2024-08-17T02:26:03.695207+0000","last_peered":"2024-08-17T02:26:03.695207+0000","last_clean":"2024-08-17T02:26:03.695207+0000","last_became_active":"2024-08-17T02:26:03.694474+0000","last_became_peered":"2024-08-17T02:26:03.694474+0000","last_unstale":"2024-08-17T02:26:03.695207+0000","last_undegraded":"2024-08-17T02:26:03.695207+0000","last_fullsized":"2024-08-17T02:26:03.695207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712848+0000","last_change":"2024-08-17T02:26:02.694813+0000","last_active":"2024-08-17T02:26:03.712848+0000","last_peered":"2024-08-17T02:26:03.712848+0000","last_clean":"2024-08-17T02:26:03.712848+0000","last_became_active":"2024-08-17T02:26:02.694536+0000","last_became_peered":"2024-08-17T02:26:02.694536+0000","last_unstale":"2024-08-17T02:26:03.712848+0000","last_undegraded":"2024-08-17T02:26:03.712848+0000","last_fullsized":"2024-08-17T02:26:03.712848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700480+0000","last_change":"2024-08-17T02:26:03.697467+0000","last_active":"2024-08-17T02:26:03.700480+0000","last_peered":"2024-08-17T02:26:03.700480+0000","last_clean":"2024-08-17T02:26:03.700480+0000","last_became_active":"2024-08-17T02:26:03.697216+0000","last_became_peered":"2024-08-17T02:26:03.697216+0000","last_unstale":"2024-08-17T02:26:03.700480+0000","last_undegraded":"2024-08-17T02:26:03.700480+0000","last_fullsized":"2024-08-17T02:26:03.700480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711824+0000","last_change":"2024-08-17T02:26:02.690442+0000","last_active":"2024-08-17T02:26:03.711824+0000","last_peered":"2024-08-17T02:26:03.711824+0000","last_clean":"2024-08-17T02:26:03.711824+0000","last_became_active":"2024-08-17T02:26:02.689103+0000","last_became_peered":"2024-08-17T02:26:02.689103+0000","last_unstale":"2024-08-17T02:26:03.711824+0000","last_undegraded":"2024-08-17T02:26:03.711824+0000","last_fullsized":"2024-08-17T02:26:03.711824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710009+0000","last_change":"2024-08-17T02:26:03.705516+0000","last_active":"2024-08-17T02:26:03.710009+0000","last_peered":"2024-08-17T02:26:03.710009+0000","last_clean":"2024-08-17T02:26:03.710009+0000","last_became_active":"2024-08-17T02:26:03.705299+0000","last_became_peered":"2024-08-17T02:26:03.705299+0000","last_unstale":"2024-08-17T02:26:03.710009+0000","last_undegraded":"2024-08-17T02:26:03.710009+0000","last_fullsized":"2024-08-17T02:26:03.710009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710612+0000","last_change":"2024-08-17T02:26:02.698824+0000","last_active":"2024-08-17T02:26:03.710612+0000","last_peered":"2024-08-17T02:26:03.710612+0000","last_clean":"2024-08-17T02:26:03.710612+0000","last_became_active":"2024-08-17T02:26:02.698592+0000","last_became_peered":"2024-08-17T02:26:02.698592+0000","last_unstale":"2024-08-17T02:26:03.710612+0000","last_undegraded":"2024-08-17T02:26:03.710612+0000","last_fullsized":"2024-08-17T02:26:03.710612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":196608,"data_stored":64456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":64492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":200704,"data_stored":64526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:08.238 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:08.238 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:26:08.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:26:08.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:26:08.239 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:26:08.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.423+0000 7fe8a7200640 1 Processor -- start 2024-08-17T02:26:08.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.423+0000 7fe8a7200640 1 -- start start 2024-08-17T02:26:08.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.424+0000 7fe8a7200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8a0155a20 0x7fe8a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe8a7200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a0156670 con 0x7fe8a006df00 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe8a7200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a006e5e0 con 0x7fe8a0155df0 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe8a7200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00b0350 con 0x7fe8a0155a20 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe8a5200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8a006df00 0x7fe8a0156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55818/0 (socket says 172.21.15.146:55818) 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe8a5200640 1 -- 172.21.15.146:0/120450254 learned_addr learned my addr 172.21.15.146:0/120450254 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89fe00640 1 --2- 172.21.15.146:0/120450254 >> v2:172.21.15.150:3300/0 conn(0x7fe8a0155a20 0x7fe8a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89ea00640 1 -- 172.21.15.146:0/120450254 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616392999 0 0) 0x7fe8a0156670 con 0x7fe8a006df00 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89ea00640 1 -- 172.21.15.146:0/120450254 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8840034e0 con 0x7fe8a006df00 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89fe00640 1 -- 172.21.15.146:0/120450254 >> v1:172.21.15.150:6789/0 conn(0x7fe8a0155df0 legacy=0x7fe8a006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89fe00640 1 -- 172.21.15.146:0/120450254 >> v1:172.21.15.146:6789/0 conn(0x7fe8a006df00 legacy=0x7fe8a0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.425+0000 7fe89fe00640 1 -- 172.21.15.146:0/120450254 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a006e8c0 con 0x7fe8a0155a20 2024-08-17T02:26:08.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.426+0000 7fe89fe00640 1 --2- 172.21.15.146:0/120450254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155a20 0x7fe8a00adf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe890009850 tx=0x7fe8900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60355b5f1d64436 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe89ea00640 1 -- 172.21.15.146:0/120450254 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89002ad90 con 0x7fe8a0155a20 2024-08-17T02:26:08.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe89ea00640 1 -- 172.21.15.146:0/120450254 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890032440 con 0x7fe8a0155a20 2024-08-17T02:26:08.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe89ea00640 1 -- 172.21.15.146:0/120450254 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900327c0 con 0x7fe8a0155a20 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe8a7200640 1 -- 172.21.15.146:0/120450254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155a20 msgr2=0x7fe8a00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe8a7200640 1 --2- 172.21.15.146:0/120450254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155a20 0x7fe8a00adf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe890009850 tx=0x7fe8900090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe8a7200640 1 -- 172.21.15.146:0/120450254 shutdown_connections 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe8a7200640 1 --2- 172.21.15.146:0/120450254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155a20 0x7fe8a00adf10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.427+0000 7fe8a7200640 1 -- 172.21.15.146:0/120450254 >> 172.21.15.146:0/120450254 conn(0x7fe8a00cb9b0 msgr2=0x7fe8a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.428+0000 7fe8a7200640 1 -- 172.21.15.146:0/120450254 shutdown_connections 2024-08-17T02:26:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.428+0000 7fe8a7200640 1 -- 172.21.15.146:0/120450254 wait complete. 2024-08-17T02:26:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.429+0000 7fe8a7200640 1 Processor -- start 2024-08-17T02:26:08.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.429+0000 7fe8a7200640 1 -- start start 2024-08-17T02:26:08.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8a0155a20 0x7fe8a00ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 0x7fe8a0146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0146c40 con 0x7fe8a006df00 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0146f20 con 0x7fe8a0155df0 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a7200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0147200 con 0x7fe8a0155a20 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe89fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe89fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40124/0 (socket says 172.21.15.146:40124) 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe89fe00640 1 -- 172.21.15.146:0/4021314883 learned_addr learned my addr 172.21.15.146:0/4021314883 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.430+0000 7fe8a5200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 0x7fe8a0146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89f400640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8a0155a20 0x7fe8a00ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 -- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8a0155a20 msgr2=0x7fe8a00ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8a0155a20 0x7fe8a00ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 -- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 msgr2=0x7fe8a0146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 0x7fe8a0146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 -- 172.21.15.146:0/4021314883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890009390 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe8a5200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 0x7fe8a0146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe89fe00640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe890009360 tx=0x7fe890032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890031a60 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890031bc0 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89003e450 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a01474e0 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.431+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a0145460 con 0x7fe8a006df00 2024-08-17T02:26:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.432+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0064db0 con 0x7fe8a006df00 2024-08-17T02:26:08.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.433+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe89003c400 con 0x7fe8a006df00 2024-08-17T02:26:08.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.434+0000 7fe897400640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 0x7fe880067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.434+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8900a26e0 con 0x7fe8a006df00 2024-08-17T02:26:08.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.434+0000 7fe89f400640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 0x7fe880067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.435+0000 7fe89f400640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 0x7fe880067600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0152420 tx=0x7fe88c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.438+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe890070700 con 0x7fe8a006df00 2024-08-17T02:26:08.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.655+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe8a006dc30 con 0x7fe8a006df00 2024-08-17T02:26:08.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.658+0000 7fe897400640 1 -- 172.21.15.146:0/4021314883 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161037 (secure 0 0 0) 0x7fe890073d20 con 0x7fe8a006df00 2024-08-17T02:26:08.660 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 msgr2=0x7fe880067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 0x7fe880067600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0152420 tx=0x7fe88c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 msgr2=0x7fe8a0147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe890009360 tx=0x7fe890032000 comp rx=0 tx=0).stop 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 shutdown_connections 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe880065150 0x7fe880067600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8a0155df0 0x7fe8a0146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe8a0155a20 0x7fe8a00ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 --2- 172.21.15.146:0/4021314883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a006df00 0x7fe8a0147ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.660+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 >> 172.21.15.146:0/4021314883 conn(0x7fe8a00cb9b0 msgr2=0x7fe8a01532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.661+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 shutdown_connections 2024-08-17T02:26:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.661+0000 7fe8a7200640 1 -- 172.21.15.146:0/4021314883 wait complete. 2024-08-17T02:26:08.675 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":36852},{"type":"v1","addr":"172.21.15.146:6833","nonce":36852}]},"active_addr":"172.21.15.146:6833/36852","active_change":"2024-08-17T02:25:42.307116+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":267782222}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":2633366938}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":3420493226}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":2837506780}]}]} 2024-08-17T02:26:08.679 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:26:08.679 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:26:08.680 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:08.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.829+0000 7fbe55200640 1 Processor -- start 2024-08-17T02:26:08.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.829+0000 7fbe55200640 1 -- start start 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.830+0000 7fbe55200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe55200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 0x7fbe500ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe55200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500afc10 con 0x7fbe5006e080 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe55200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500ae5b0 con 0x7fbe50155550 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe55200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500af000 con 0x7fbe50155180 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe45400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 0x7fbe500ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe4de00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe45400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 0x7fbe500ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39780/0 (socket says 172.21.15.146:39780) 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe45400640 1 -- 172.21.15.146:0/1799998395 learned_addr learned my addr 172.21.15.146:0/1799998395 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe4de00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33258/0 (socket says 172.21.15.146:33258) 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe4de00640 1 -- 172.21.15.146:0/1799998395 >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 msgr2=0x7fbe500ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe4de00640 1 --2- 172.21.15.146:0/1799998395 >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 0x7fbe500ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.831+0000 7fbe4de00640 1 -- 172.21.15.146:0/1799998395 >> v1:172.21.15.150:6789/0 conn(0x7fbe5006e080 legacy=0x7fbe5006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.832+0000 7fbe4de00640 1 -- 172.21.15.146:0/1799998395 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500af2e0 con 0x7fbe50155180 2024-08-17T02:26:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe4de00640 1 --2- 172.21.15.146:0/1799998395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009850 tx=0x7fbe400090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdd463d28eae63c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe4d400640 1 -- 172.21.15.146:0/1799998395 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4002ad90 con 0x7fbe50155180 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe4d400640 1 -- 172.21.15.146:0/1799998395 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40032440 con 0x7fbe50155180 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe4d400640 1 -- 172.21.15.146:0/1799998395 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40032820 con 0x7fbe50155180 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 -- 172.21.15.146:0/1799998395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 msgr2=0x7fbe500aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 --2- 172.21.15.146:0/1799998395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009850 tx=0x7fbe400090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 -- 172.21.15.146:0/1799998395 shutdown_connections 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 --2- 172.21.15.146:0/1799998395 >> v2:172.21.15.150:3300/0 conn(0x7fbe50155550 0x7fbe500ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 --2- 172.21.15.146:0/1799998395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500aea20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 -- 172.21.15.146:0/1799998395 >> 172.21.15.146:0/1799998395 conn(0x7fbe500cb9b0 msgr2=0x7fbe500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.833+0000 7fbe55200640 1 -- 172.21.15.146:0/1799998395 shutdown_connections 2024-08-17T02:26:08.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.834+0000 7fbe55200640 1 -- 172.21.15.146:0/1799998395 wait complete. 2024-08-17T02:26:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.835+0000 7fbe55200640 1 Processor -- start 2024-08-17T02:26:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.835+0000 7fbe55200640 1 -- start start 2024-08-17T02:26:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 0x7fbe50158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50155c90 con 0x7fbe50155550 2024-08-17T02:26:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50156620 con 0x7fbe5006e080 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe55200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50156be0 con 0x7fbe50155180 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe4e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe45400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe4de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 0x7fbe50158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe4e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40128/0 (socket says 172.21.15.146:40128) 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.836+0000 7fbe4e800640 1 -- 172.21.15.146:0/4161182765 learned_addr learned my addr 172.21.15.146:0/4161182765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 -- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 msgr2=0x7fbe500c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 -- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 msgr2=0x7fbe50158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 0x7fbe50158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 -- 172.21.15.146:0/4161182765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40009390 con 0x7fbe50155550 2024-08-17T02:26:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe45400640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4de00640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 0x7fbe50158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe4e800640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c870 tx=0x7fbe48001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800ce60 con 0x7fbe50155550 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48006b10 con 0x7fbe50155550 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50144490 con 0x7fbe50155550 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800a850 con 0x7fbe50155550 2024-08-17T02:26:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.837+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe501561c0 con 0x7fbe50155550 2024-08-17T02:26:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.838+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe50064db0 con 0x7fbe50155550 2024-08-17T02:26:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.839+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe4800ac80 con 0x7fbe50155550 2024-08-17T02:26:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.840+0000 7fbe46000640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 0x7fbe2c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.840+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe480821b0 con 0x7fbe50155550 2024-08-17T02:26:08.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.840+0000 7fbe4de00640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 0x7fbe2c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.841+0000 7fbe4de00640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 0x7fbe2c067630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe40034000 tx=0x7fbe40032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:08.844+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe48050320 con 0x7fbe50155550 2024-08-17T02:26:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.017+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe50156d20 con 0x7fbe50155550 2024-08-17T02:26:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.018+0000 7fbe46000640 1 -- 172.21.15.146:0/4161182765 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbe48053940 con 0x7fbe50155550 2024-08-17T02:26:09.019 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:09.019 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 msgr2=0x7fbe2c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 0x7fbe2c067630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe40034000 tx=0x7fbe40032000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 msgr2=0x7fbe500c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c870 tx=0x7fbe48001690 comp rx=0 tx=0).stop 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 shutdown_connections 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbe2c065180 0x7fbe2c067630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe50155550 0x7fbe500c8c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe50155180 0x7fbe500c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 --2- 172.21.15.146:0/4161182765 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe5006e080 0x7fbe50158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 >> 172.21.15.146:0/4161182765 conn(0x7fbe500cb9b0 msgr2=0x7fbe500687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 shutdown_connections 2024-08-17T02:26:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.020+0000 7fbe55200640 1 -- 172.21.15.146:0/4161182765 wait complete. 2024-08-17T02:26:09.035 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:26:09.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.183+0000 7f9ef8000640 1 Processor -- start 2024-08-17T02:26:09.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.183+0000 7f9ef8000640 1 -- start start 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 0x7f9ef00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ef0155df0 0x7f9ef00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00b0350 con 0x7f9ef0155df0 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef0156670 con 0x7f9ef0155a20 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.184+0000 7f9ef8000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef006e180 con 0x7f9ef006d7f0 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ef0155df0 0x7f9ef00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ef0155df0 0x7f9ef00ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40136/0 (socket says 172.21.15.146:40136) 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 -- 172.21.15.146:0/1769909334 learned_addr learned my addr 172.21.15.146:0/1769909334 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef6000640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef5600640 1 --2- 172.21.15.146:0/1769909334 >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 0x7f9ef00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 -- 172.21.15.146:0/1769909334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 msgr2=0x7f9ef006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 -- 172.21.15.146:0/1769909334 >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 msgr2=0x7f9ef00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 --2- 172.21.15.146:0/1769909334 >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 0x7f9ef00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef4c00640 1 -- 172.21.15.146:0/1769909334 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef006e5e0 con 0x7f9ef0155df0 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef6000640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.185+0000 7f9ef5600640 1 --2- 172.21.15.146:0/1769909334 >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 0x7f9ef00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.186+0000 7f9ef4c00640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef00ad9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ef006bc00 tx=0x7f9edc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7c20e9b4bc6449 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.186+0000 7f9eefe00640 1 -- 172.21.15.146:0/1769909334 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc02add0 con 0x7f9ef0155df0 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.186+0000 7f9eefe00640 1 -- 172.21.15.146:0/1769909334 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc032440 con 0x7f9ef0155df0 2024-08-17T02:26:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.186+0000 7f9eefe00640 1 -- 172.21.15.146:0/1769909334 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc032820 con 0x7f9ef0155df0 2024-08-17T02:26:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 -- 172.21.15.146:0/1769909334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 msgr2=0x7f9ef00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef00ad9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ef006bc00 tx=0x7f9edc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 -- 172.21.15.146:0/1769909334 shutdown_connections 2024-08-17T02:26:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 --2- 172.21.15.146:0/1769909334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef00ad9b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 --2- 172.21.15.146:0/1769909334 >> v2:172.21.15.150:3300/0 conn(0x7f9ef0155a20 0x7f9ef00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 -- 172.21.15.146:0/1769909334 >> 172.21.15.146:0/1769909334 conn(0x7f9ef00cb9b0 msgr2=0x7f9ef00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 -- 172.21.15.146:0/1769909334 shutdown_connections 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.187+0000 7f9ef8000640 1 -- 172.21.15.146:0/1769909334 wait complete. 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.189+0000 7f9ef8000640 1 Processor -- start 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.189+0000 7f9ef8000640 1 -- start start 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.189+0000 7f9ef8000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef00ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef8000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ef0155a20 0x7f9ef01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef8000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef8000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00ac270 con 0x7f9ef0155df0 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef8000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00ac510 con 0x7f9ef0155a20 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef8000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00ac7f0 con 0x7f9ef006d7f0 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef5600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef00ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40144/0 (socket says 172.21.15.146:40144) 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 -- 172.21.15.146:0/2805152043 learned_addr learned my addr 172.21.15.146:0/2805152043 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef4c00640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ef0155a20 0x7f9ef01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 -- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 msgr2=0x7f9ef00ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef00ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 -- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ef0155a20 msgr2=0x7f9ef01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ef0155a20 0x7f9ef01548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 -- 172.21.15.146:0/2805152043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009450 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.190+0000 7f9ef6000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800d180 tx=0x7f9ee8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.191+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8015440 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.191+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800f040 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.191+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00acad0 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.191+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8015810 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.191+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0154df0 con 0x7f9ef0155df0 2024-08-17T02:26:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.192+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef00acfd0 con 0x7f9ef0155df0 2024-08-17T02:26:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.193+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ee801e3b0 con 0x7f9ef0155df0 2024-08-17T02:26:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.193+0000 7f9eecc00640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 0x7f9ed0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.194+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ee8082dc0 con 0x7f9ef0155df0 2024-08-17T02:26:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.194+0000 7f9ef5600640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 0x7f9ed0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.194+0000 7f9ef5600640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 0x7f9ed0067600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400bc10 tx=0x7f9ee4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.197+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ee8050f30 con 0x7f9ef0155df0 2024-08-17T02:26:09.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.371+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ef0064db0 con 0x7f9ef0155df0 2024-08-17T02:26:09.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.372+0000 7f9eecc00640 1 -- 172.21.15.146:0/2805152043 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f9ee8054550 con 0x7f9ef0155df0 2024-08-17T02:26:09.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:09.372 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:09.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 msgr2=0x7f9ed0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 0x7f9ed0067600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400bc10 tx=0x7f9ee4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 msgr2=0x7f9ef0143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800d180 tx=0x7f9ee8009a50 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 shutdown_connections 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9ed0065150 0x7f9ed0067600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ef0155df0 0x7f9ef0143fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ef0155a20 0x7f9ef01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 --2- 172.21.15.146:0/2805152043 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ef006d7f0 0x7f9ef00ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 >> 172.21.15.146:0/2805152043 conn(0x7f9ef00cb9b0 msgr2=0x7f9ef01582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 shutdown_connections 2024-08-17T02:26:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.374+0000 7f9ef8000640 1 -- 172.21.15.146:0/2805152043 wait complete. 2024-08-17T02:26:09.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:26:09.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:26:09.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:26:09.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:26:09.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:26:09.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:26:09.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:26:09.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:26:09.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.656+0000 7f96d1a00640 1 Processor -- start 2024-08-17T02:26:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.656+0000 7f90d9200640 1 Processor -- start 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.656+0000 7f90d9200640 1 -- start start 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d9200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90cc00db90 0x7f90cc00df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d9200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc052a00 con 0x7f90cc0518a0 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.656+0000 7f96d1a00640 1 -- start start 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.658+0000 7f96d1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 0x7f96cc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.658+0000 7f96d1a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 0x7f96cc0acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.658+0000 7f96d1a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0cf9d0 con 0x7f96cc0cd700 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.658+0000 7f96d1a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0ceb60 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.658+0000 7f96d1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0cedc0 con 0x7f96cc158c80 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f96d1000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 0x7f96cc0acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f96d1000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 0x7f96cc0acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40152/0 (socket says 172.21.15.146:40152) 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f96d1000640 1 -- 172.21.15.146:0/1619272342 learned_addr learned my addr 172.21.15.146:0/1619272342 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f5bf2600640 1 Processor -- start 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d9200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc051df0 con 0x7f90cc055a80 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d2a00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f90cc055a80 0x7f90cc0e5e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48268/0 (socket says 172.21.15.146:48268) 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d9200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0520d0 con 0x7f90cc00db90 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f5bf2600640 1 -- start start 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f90d3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f90cc0518a0 0x7f90cc007af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55826/0 (socket says 172.21.15.146:55826) 2024-08-17T02:26:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.660+0000 7f90d3e00640 1 -- 172.21.15.146:0/3786368269 learned_addr learned my addr 172.21.15.146:0/3786368269 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.659+0000 7f96cbe00640 1 --2- 172.21.15.146:0/1619272342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 0x7f96cc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.660+0000 7f96cbe00640 1 -- 172.21.15.146:0/1619272342 >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 msgr2=0x7f96cc0acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.660+0000 7f96cbe00640 1 --2- 172.21.15.146:0/1619272342 >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 0x7f96cc0acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.660+0000 7f96cbe00640 1 -- 172.21.15.146:0/1619272342 >> v1:172.21.15.150:6789/0 conn(0x7f96cc0cd700 legacy=0x7f96cc0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.660+0000 7f96cbe00640 1 -- 172.21.15.146:0/1619272342 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0cf0a0 con 0x7f96cc158c80 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.661+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036111026 0 0) 0x7f90cc052a00 con 0x7f90cc0518a0 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.661+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90bc0034e0 con 0x7f90cc0518a0 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292705985 0 0) 0x7f90cc051df0 con 0x7f90cc055a80 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90cc052a00 con 0x7f90cc055a80 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716554550 0 0) 0x7f90cc052a00 con 0x7f90cc055a80 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 >> v2:172.21.15.150:3300/0 conn(0x7f90cc00db90 msgr2=0x7f90cc00df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d3400640 1 --2- 172.21.15.146:0/3786368269 >> v2:172.21.15.150:3300/0 conn(0x7f90cc00db90 0x7f90cc00df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f96cbe00640 1 --2- 172.21.15.146:0/1619272342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 0x7f96cc0ce620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009850 tx=0x7f96b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=335a0c646c5fba86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5bf2600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 0x7f5bec0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5bf2600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0af6e0 con 0x7f5bec13e360 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5bf2600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0acb40 con 0x7f5bec06a5e0 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5bf2600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0ad6c0 con 0x7f5bec13e730 2024-08-17T02:26:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f96caa00640 1 -- 172.21.15.146:0/1619272342 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b802ab60 con 0x7f96cc158c80 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 --2- 172.21.15.146:0/3786368269 >> v2:172.21.15.150:3300/0 conn(0x7f90cc00db90 0x7f90cc00df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 >> v1:172.21.15.146:6789/0 conn(0x7f90cc0518a0 legacy=0x7f90cc007af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0523b0 con 0x7f90cc055a80 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f90c00013a0 con 0x7f90cc055a80 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.662+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 >> v1:172.21.15.150:6789/0 conn(0x7f90cc055a80 legacy=0x7f90cc0e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90bc003b60 0x7f90bc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc004780 0x7f90bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 0x7f90bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d404c200 con 0x7f90bc005130 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0520d0 con 0x7f90bc003b60 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc00c0a0 con 0x7f90bc004780 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5be2a00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5bec06a5e0 0x7f5bec0aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48278/0 (socket says 172.21.15.146:48278) 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5be2a00640 1 -- 172.21.15.146:0/2256542200 learned_addr learned my addr 172.21.15.146:0/2256542200 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:09.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f5bebe00640 1 --2- 172.21.15.146:0/2256542200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 0x7f5bec0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d3e00640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 0x7f90bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f90d3400640 1 --2- 172.21.15.146:0/3786368269 >> v2:172.21.15.150:3300/0 conn(0x7f90cc00db90 0x7f90cc00df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d2a00640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc004780 0x7f90bc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f96caa00640 1 -- 172.21.15.146:0/1619272342 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b802acc0 con 0x7f96cc158c80 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.663+0000 7f96caa00640 1 -- 172.21.15.146:0/1619272342 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8032650 con 0x7f96cc158c80 2024-08-17T02:26:09.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f5bebe00640 1 -- 172.21.15.146:0/2256542200 >> v1:172.21.15.150:6789/0 conn(0x7f5bec06a5e0 legacy=0x7f5bec0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3e00640 1 -- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc004780 msgr2=0x7f90bc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3e00640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc004780 0x7f90bc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3e00640 1 -- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90bc003b60 msgr2=0x7f90bc003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3400640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90bc003b60 0x7f90bc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3e00640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90bc003b60 0x7f90bc003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3e00640 1 -- 172.21.15.146:0/3786368269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0523b0 con 0x7f90bc005130 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.664+0000 7f90d3400640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90bc003b60 0x7f90bc003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f90d3e00640 1 -- 172.21.15.146:0/3786368269 reap_dead start 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f96d1a00640 1 -- 172.21.15.146:0/1619272342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 msgr2=0x7f96cc0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f96d1a00640 1 --2- 172.21.15.146:0/1619272342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 0x7f96cc0ce620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009850 tx=0x7f96b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f90d3e00640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 0x7f90bc00b9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90d4060af0 tx=0x7f90d406f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a0adeced73dd94 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40a35c0 con 0x7f90bc005130 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40a3720 con 0x7f90bc005130 2024-08-17T02:26:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f90d2000640 1 -- 172.21.15.146:0/3786368269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40a3ac0 con 0x7f90bc005130 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.665+0000 7f96d1a00640 1 -- 172.21.15.146:0/1619272342 shutdown_connections 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f96d1a00640 1 --2- 172.21.15.146:0/1619272342 >> v2:172.21.15.146:3300/0 conn(0x7f96cc0cc9d0 0x7f96cc0acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f96d1a00640 1 --2- 172.21.15.146:0/1619272342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc158c80 0x7f96cc0ce620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f96d1a00640 1 -- 172.21.15.146:0/1619272342 >> 172.21.15.146:0/1619272342 conn(0x7f96cc098e30 msgr2=0x7f96cc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f90d9200640 1 -- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 msgr2=0x7f90bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f90d9200640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 0x7f90bc00b9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90d4060af0 tx=0x7f90d406f710 comp rx=0 tx=0).stop 2024-08-17T02:26:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f96d1a00640 1 -- 172.21.15.146:0/1619272342 shutdown_connections 2024-08-17T02:26:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f90d9200640 1 -- 172.21.15.146:0/3786368269 shutdown_connections 2024-08-17T02:26:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.666+0000 7f96d1a00640 1 -- 172.21.15.146:0/1619272342 wait complete. 2024-08-17T02:26:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f90d9200640 1 --2- 172.21.15.146:0/3786368269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90bc005130 0x7f90bc00b9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f90d9200640 1 -- 172.21.15.146:0/3786368269 >> 172.21.15.146:0/3786368269 conn(0x7f90cc00a7d0 msgr2=0x7f90cc056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f2a0b200640 1 Processor -- start 2024-08-17T02:26:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f5bebe00640 1 -- 172.21.15.146:0/2256542200 >> v1:172.21.15.146:6789/0 conn(0x7f5bec13e360 legacy=0x7f5bec069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f5bebe00640 1 -- 172.21.15.146:0/2256542200 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0acd90 con 0x7f5bec13e730 2024-08-17T02:26:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f90d9200640 1 -- 172.21.15.146:0/3786368269 shutdown_connections 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f90d9200640 1 -- 172.21.15.146:0/3786368269 wait complete. 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.667+0000 7f2a0b200640 1 -- start start 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.668+0000 7f2a0b200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a0415a260 0x7f2a040b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.668+0000 7f2a0b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040adb60 con 0x7f2a04096a70 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.668+0000 7f2a0b200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040975a0 con 0x7f2a040abbf0 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.668+0000 7f2a0b200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0415a630 con 0x7f2a0415a260 2024-08-17T02:26:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.668+0000 7f2a03e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a0415a260 0x7f2a040b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f2a03e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a0415a260 0x7f2a040b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39842/0 (socket says 172.21.15.146:39842) 2024-08-17T02:26:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f2a03e00640 1 -- 172.21.15.146:0/2773808250 learned_addr learned my addr 172.21.15.146:0/2773808250 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f90d9200640 1 Processor -- start 2024-08-17T02:26:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718568386 0 0) 0x7f2a040adb60 con 0x7f2a04096a70 2024-08-17T02:26:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29e80034e0 con 0x7f2a04096a70 2024-08-17T02:26:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f96d1a00640 1 Processor -- start 2024-08-17T02:26:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f96d1a00640 1 -- start start 2024-08-17T02:26:09.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449231099 0 0) 0x7f29e80034e0 con 0x7f2a04096a70 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 >> v2:172.21.15.150:3300/0 conn(0x7f2a0415a260 msgr2=0x7f2a040b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 --2- 172.21.15.146:0/2773808250 >> v2:172.21.15.150:3300/0 conn(0x7f2a0415a260 0x7f2a040b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 >> v1:172.21.15.150:6789/0 conn(0x7f2a040abbf0 legacy=0x7f2a040adff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040b2dc0 con 0x7f2a04096a70 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f29f4001470 con 0x7f2a04096a70 2024-08-17T02:26:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.669+0000 7f90d9200640 1 -- start start 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 >> v1:172.21.15.146:6789/0 conn(0x7f2a04096a70 legacy=0x7f2a040ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8003a50 0x7f29e8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 0x7f29e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8005180 0x7f29e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0415a630 con 0x7f29e8005180 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e800c150 con 0x7f29e8003a50 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e800c310 con 0x7f29e8004780 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03400640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 0x7f29e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f90d9200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 0x7f90cc0f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.670+0000 7f90d9200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc04e510 0x7f90cc0d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f90d9200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90cc04bb40 0x7f90cc04bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f90d9200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc04fbb0 con 0x7f90cc04e510 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f90d9200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc04c4f0 con 0x7f90cc04bb40 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f90d9200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0e37f0 con 0x7f90bc005130 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc0cc9d0 0x7f96cc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03e00640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8003a50 0x7f29e8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc0cd700 0x7f96cc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc158c80 0x7f96cc1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc15b810 con 0x7f96cc158c80 2024-08-17T02:26:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc15ac00 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f96d1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc15aee0 con 0x7f96cc0cd700 2024-08-17T02:26:09.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03400640 1 -- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8003a50 msgr2=0x7f29e8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03400640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8003a50 0x7f29e8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f96cbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc0cc9d0 0x7f96cc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f90d2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc04e510 0x7f90cc0d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f90d3400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 0x7f90cc0f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f90d3400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 0x7f90cc0f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33346/0 (socket says 172.21.15.146:33346) 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f90d3400640 1 -- 172.21.15.146:0/1655401848 learned_addr learned my addr 172.21.15.146:0/1655401848 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f96cb400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc0cd700 0x7f96cc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f96cb400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc0cd700 0x7f96cc15a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33330/0 (socket says 172.21.15.146:33330) 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f96cb400640 1 -- 172.21.15.146:0/2453205473 learned_addr learned my addr 172.21.15.146:0/2453205473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f96d1000640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc158c80 0x7f96cc1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03400640 1 -- 172.21.15.146:0/2773808250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8005180 msgr2=0x7f29e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f90d3e00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90cc04bb40 0x7f90cc04bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.671+0000 7f2a03400640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e8005180 0x7f29e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f2a03400640 1 -- 172.21.15.146:0/2773808250 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040b2dc0 con 0x7f29e8004780 2024-08-17T02:26:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f5bebe00640 1 --2- 172.21.15.146:0/2256542200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 0x7f5bec0adb50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5be4008880 tx=0x7f5be4008190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61f089b46637b93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.672+0000 7f5beaa00640 1 -- 172.21.15.146:0/2256542200 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4032480 con 0x7f5bec13e730 2024-08-17T02:26:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f2a09200640 1 -- 172.21.15.146:0/2773808250 reap_dead start 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3e00640 1 -- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 msgr2=0x7f90cc0f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3e00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 0x7f90cc0f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3e00640 1 -- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc04e510 msgr2=0x7f90cc0d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3e00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc04e510 0x7f90cc0d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3e00640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0f7ad0 con 0x7f90cc04bb40 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f90d3400640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90bc005130 0x7f90cc0f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f96cbe00640 1 -- 172.21.15.146:0/2453205473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc0cd700 msgr2=0x7f96cc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f96cbe00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96cc0cd700 0x7f96cc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f2a03400640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 0x7f29e8004bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29e8004700 tx=0x7f29f40077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c103f475513fdf4b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f5beaa00640 1 -- 172.21.15.146:0/2256542200 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be402f030 con 0x7f5bec13e730 2024-08-17T02:26:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f5beaa00640 1 -- 172.21.15.146:0/2256542200 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4032850 con 0x7f5bec13e730 2024-08-17T02:26:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.673+0000 7f5bf2600640 1 -- 172.21.15.146:0/2256542200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 msgr2=0x7f5bec0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f90d3e00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90cc04bb40 0x7f90cc04bfb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90d402ae30 tx=0x7f90d40aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f96cbe00640 1 -- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc158c80 msgr2=0x7f96cc1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f96cbe00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc158c80 0x7f96cc1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f96cbe00640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8009390 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f5bf2600640 1 --2- 172.21.15.146:0/2256542200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 0x7f5bec0adb50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5be4008880 tx=0x7f5be4008190 comp rx=0 tx=0).stop 2024-08-17T02:26:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40a3e70 con 0x7f90cc04bb40 2024-08-17T02:26:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f96d1000640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96cc158c80 0x7f96cc1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f5bf2600640 1 -- 172.21.15.146:0/2256542200 shutdown_connections 2024-08-17T02:26:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f5bf2600640 1 --2- 172.21.15.146:0/2256542200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec13e730 0x7f5bec0adb50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f5bf2600640 1 -- 172.21.15.146:0/2256542200 >> 172.21.15.146:0/2256542200 conn(0x7f5bec0cc480 msgr2=0x7f5bec0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.674+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4031400 con 0x7f29e8004780 2024-08-17T02:26:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f96cbe00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc0cc9d0 0x7f96cc1550a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b8031000 tx=0x7f96b8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f2a02a00640 1 -- 172.21.15.146:0/2773808250 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f402d050 con 0x7f29e8004780 2024-08-17T02:26:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40aba60 con 0x7f90cc04bb40 2024-08-17T02:26:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40abde0 con 0x7f90cc04bb40 2024-08-17T02:26:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f5bf2600640 1 -- 172.21.15.146:0/2256542200 shutdown_connections 2024-08-17T02:26:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc0d3630 con 0x7f90cc04bb40 2024-08-17T02:26:09.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc04ecf0 con 0x7f90cc04bb40 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b803c6e0 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b803c840 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b803cc00 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 -- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 msgr2=0x7f29e8004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 0x7f29e8004bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f29e8004700 tx=0x7f29f40077a0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc15b1c0 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc1555e0 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.675+0000 7f5bf2600640 1 -- 172.21.15.146:0/2256542200 wait complete. 2024-08-17T02:26:09.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 -- 172.21.15.146:0/2773808250 shutdown_connections 2024-08-17T02:26:09.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 --2- 172.21.15.146:0/2773808250 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29e8004780 0x7f29e8004bf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 -- 172.21.15.146:0/2773808250 >> 172.21.15.146:0/2773808250 conn(0x7f2a040b3040 msgr2=0x7f2a040b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f1dcdc00640 1 Processor -- start 2024-08-17T02:26:09.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90cc005320 con 0x7f90cc04bb40 2024-08-17T02:26:09.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f1dcdc00640 1 -- start start 2024-08-17T02:26:09.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.677+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96cc071050 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 -- 172.21.15.146:0/2773808250 shutdown_connections 2024-08-17T02:26:09.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2a0b200640 1 -- 172.21.15.146:0/2773808250 wait complete. 2024-08-17T02:26:09.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.676+0000 7f2b69200640 1 Processor -- start 2024-08-17T02:26:09.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.677+0000 7f2b69200640 1 -- start start 2024-08-17T02:26:09.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f1dcdc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1dc80cc1b0 0x7f1dc80a9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8159740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f1dcdc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc8067c80 con 0x7f1dc80a9490 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f1dcdc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc806d1d0 con 0x7f1dc80cc1b0 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f1dcdc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8067070 con 0x7f1dc8068110 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f8ade200640 1 Processor -- start 2024-08-17T02:26:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.678+0000 7f5bf2600640 1 Processor -- start 2024-08-17T02:26:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f2b69200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b640aa810 0x7f2b640aac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f1dc6a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1dc80a9490 0x7f1dc8159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55858/0 (socket says 172.21.15.146:55858) 2024-08-17T02:26:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f1dc6a00640 1 -- 172.21.15.146:0/141799068 learned_addr learned my addr 172.21.15.146:0/141799068 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f1dc7400640 1 --2- 172.21.15.146:0/141799068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f2b69200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b64067de0 con 0x7f2b64165050 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f2b69200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640ab1c0 con 0x7f2b64157b20 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f2b69200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640ae900 con 0x7f2b640aa810 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f8ade200640 1 -- start start 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f2b61e00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f2b64157b20 0x7f2b640abc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48282/0 (socket says 172.21.15.146:48282) 2024-08-17T02:26:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f2b61e00640 1 -- 172.21.15.146:0/3084392167 learned_addr learned my addr 172.21.15.146:0/3084392167 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:09.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f1dc7400640 1 -- 172.21.15.146:0/141799068 >> v2:172.21.15.146:3300/0 conn(0x7f1dc80cc1b0 msgr2=0x7f1dc80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f1dc6000640 1 --2- 172.21.15.146:0/141799068 >> v2:172.21.15.146:3300/0 conn(0x7f1dc80cc1b0 0x7f1dc80a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f1dc7400640 1 --2- 172.21.15.146:0/141799068 >> v2:172.21.15.146:3300/0 conn(0x7f1dc80cc1b0 0x7f1dc80a9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f1dc7400640 1 -- 172.21.15.146:0/141799068 >> v1:172.21.15.146:6789/0 conn(0x7f1dc80a9490 legacy=0x7f1dc8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f1dc7400640 1 -- 172.21.15.146:0/141799068 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8067350 con 0x7f1dc8068110 2024-08-17T02:26:09.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f2b61400640 1 --2- 172.21.15.146:0/3084392167 >> v2:172.21.15.150:3300/0 conn(0x7f2b640aa810 0x7f2b640aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f2a0b200640 1 Processor -- start 2024-08-17T02:26:09.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.679+0000 7f5bf2600640 1 -- start start 2024-08-17T02:26:09.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f5bf2600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec06a5e0 0x7f5bec157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f96b803b3a0 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f2a0b200640 1 -- start start 2024-08-17T02:26:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f5bf2600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec13e360 0x7f5bec170b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f8ade200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ad80ada10 0x7f8ad80b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f8ade200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ad80b1120 0x7f8ad80b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f8ade200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad80d0ab0 con 0x7f8ad80b36e0 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f8ade200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80b00c0 con 0x7f8ad80b1120 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f8ade200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad80b0360 con 0x7f8ad80ada10 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f5beb400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec06a5e0 0x7f5bec157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f5beb400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec06a5e0 0x7f5bec157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33368/0 (socket says 172.21.15.146:33368) 2024-08-17T02:26:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.680+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f90d40be3f0 con 0x7f90cc04bb40 2024-08-17T02:26:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f90c6a00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f90b4065220 0x7f90b40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.681+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90d40a7070 con 0x7f90cc04bb40 2024-08-17T02:26:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f90c6a00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f90b406d430 0x7f90b406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f5beb400640 1 -- 172.21.15.146:0/13894393 learned_addr learned my addr 172.21.15.146:0/13894393 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f1dc7400640 1 --2- 172.21.15.146:0/141799068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8159740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009850 tx=0x7f1db40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c10f34089608ba7a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ad80ada10 0x7f8ad80b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ad80ada10 0x7f8ad80b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39876/0 (socket says 172.21.15.146:39876) 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 -- 172.21.15.146:0/2406738876 learned_addr learned my addr 172.21.15.146:0/2406738876 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2b61400640 1 -- 172.21.15.146:0/3084392167 >> v1:172.21.15.150:6789/0 conn(0x7f2b64157b20 legacy=0x7f2b640abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2b61400640 1 -- 172.21.15.146:0/3084392167 >> v1:172.21.15.146:6789/0 conn(0x7f2b64165050 legacy=0x7f2b64167430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2b61400640 1 -- 172.21.15.146:0/3084392167 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640acfe0 con 0x7f2b640aa810 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90b406fef0 con 0x7f90b406d430 2024-08-17T02:26:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90d41195a0 con 0x7f90cc04bb40 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f90d3400640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f90b4065220 0x7f90b40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8004780 0x7f2a0409af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 0x7f2a04153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a04098660 0x7f2a04152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04098af0 con 0x7f2a04098660 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a04099f10 con 0x7f29e8004780 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a0b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0409a190 con 0x7f2a040981f0 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a03400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 0x7f2a04153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a03400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 0x7f2a04153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33370/0 (socket says 172.21.15.146:33370) 2024-08-17T02:26:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f2a03400640 1 -- 172.21.15.146:0/2441329701 learned_addr learned my addr 172.21.15.146:0/2441329701 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f1dc5600640 1 -- 172.21.15.146:0/141799068 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4030510 con 0x7f1dc8068110 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f1dc5600640 1 -- 172.21.15.146:0/141799068 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db402e050 con 0x7f1dc8068110 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f1dc5600640 1 -- 172.21.15.146:0/141799068 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db40308e0 con 0x7f1dc8068110 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 -- 172.21.15.146:0/2406738876 >> v2:172.21.15.146:3300/0 conn(0x7f8ad80b1120 msgr2=0x7f8ad80b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 --2- 172.21.15.146:0/2406738876 >> v2:172.21.15.146:3300/0 conn(0x7f8ad80b1120 0x7f8ad80b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 -- 172.21.15.146:0/2406738876 >> v1:172.21.15.146:6789/0 conn(0x7f8ad80b36e0 legacy=0x7f8ad80adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f8ad7400640 1 -- 172.21.15.146:0/2406738876 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80b0640 con 0x7f8ad80ada10 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f90d2a00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f90b406d430 0x7f90b406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f96c3400640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f96ac065250 0x7f96ac067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96b80a2480 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f96c3400640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f96ac06d460 0x7f96ac06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f5bf2600640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec13e730 0x7f5bec15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec12aad0 con 0x7f5bec13e360 2024-08-17T02:26:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec158700 con 0x7f5bec13e730 2024-08-17T02:26:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.682+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1589e0 con 0x7f5bec06a5e0 2024-08-17T02:26:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f2a03400640 1 -- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8004780 msgr2=0x7f2a0409af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f2a03e00640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8004780 0x7f2a0409af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f90d2a00640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f90b406d430 0x7f90b406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f90d3400640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f90b4065220 0x7f90b40676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90c8010500 tx=0x7f90c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.683+0000 7f96cb400640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f96ac065250 0x7f96ac067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 -- 172.21.15.146:0/141799068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 msgr2=0x7f1dc8159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/141799068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8159740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009850 tx=0x7f1db40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f8ad7400640 1 --2- 172.21.15.146:0/2406738876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad80b2c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80b5ec0 tx=0x7f8ac80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ddd162ce44328f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f5be2a00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec13e360 0x7f5bec170b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f2a03400640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8004780 0x7f2a0409af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f2a03400640 1 -- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a04098660 msgr2=0x7f2a04152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f2a03400640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a04098660 0x7f2a04152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f2a03400640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0409a470 con 0x7f2a040981f0 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f8ad6000640 1 -- 172.21.15.146:0/2406738876 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac802ae00 con 0x7f8ad80ada10 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 -- 172.21.15.146:0/141799068 shutdown_connections 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/141799068 >> v2:172.21.15.146:3300/0 conn(0x7f1dc80cc1b0 0x7f1dc80a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/141799068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8159740 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 -- 172.21.15.146:0/141799068 >> 172.21.15.146:0/141799068 conn(0x7f1dc80afca0 msgr2=0x7f1dc80b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f2b61400640 1 --2- 172.21.15.146:0/3084392167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b640aa810 0x7f2b640aac80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009850 tx=0x7f2b500090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91389a67f1623a91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f1dcdc00640 1 -- 172.21.15.146:0/141799068 shutdown_connections 2024-08-17T02:26:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96ac06ff20 con 0x7f96ac06d460 2024-08-17T02:26:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96b80a4ac0 con 0x7f96cc0cc9d0 2024-08-17T02:26:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f8ad6000640 1 -- 172.21.15.146:0/2406738876 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8032440 con 0x7f8ad80ada10 2024-08-17T02:26:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f8ad6000640 1 -- 172.21.15.146:0/2406738876 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8032820 con 0x7f8ad80ada10 2024-08-17T02:26:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f1dcdc00640 1 -- 172.21.15.146:0/141799068 wait complete. 2024-08-17T02:26:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.684+0000 7f5bebe00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec13e730 0x7f5bec15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f2a03e00640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29e8004780 0x7f2a0409af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== osd.0 v2:172.21.15.146:6808/37113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f90b406fef0 con 0x7f90b406d430 2024-08-17T02:26:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f96d1000640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f96ac06d460 0x7f96ac06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 -- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec06a5e0 msgr2=0x7f5bec157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5bec06a5e0 0x7f5bec157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 -- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec13e360 msgr2=0x7f5bec170b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f2a03400640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 0x7f2a04153250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000fd0 tx=0x7f29f4035000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f2b60a00640 1 -- 172.21.15.146:0/3084392167 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5002ad20 con 0x7f2b640aa810 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f8ade200640 1 -- 172.21.15.146:0/2406738876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 msgr2=0x7f8ad80b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec13e360 0x7f5bec170b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4008410 con 0x7f5bec13e730 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5be2a00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec13e360 0x7f5bec170b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f5bebe00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec13e730 0x7f5bec15fa80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5be4034000 tx=0x7f5be403a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4007250 con 0x7f2a040981f0 2024-08-17T02:26:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f40073b0 con 0x7f2a040981f0 2024-08-17T02:26:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f4006790 con 0x7f2a040981f0 2024-08-17T02:26:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0409a750 con 0x7f2a040981f0 2024-08-17T02:26:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.685+0000 7f8ade200640 1 --2- 172.21.15.146:0/2406738876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad80b2c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80b5ec0 tx=0x7f8ac80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0409b490 con 0x7f2a040981f0 2024-08-17T02:26:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f8ade200640 1 -- 172.21.15.146:0/2406738876 shutdown_connections 2024-08-17T02:26:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f8ade200640 1 --2- 172.21.15.146:0/2406738876 >> v2:172.21.15.146:3300/0 conn(0x7f8ad80b1120 0x7f8ad80b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f8ade200640 1 --2- 172.21.15.146:0/2406738876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad80b2c60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.686+0000 7f8ade200640 1 -- 172.21.15.146:0/2406738876 >> 172.21.15.146:0/2406738876 conn(0x7f8ad80cfdf0 msgr2=0x7f8ad80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f96cb400640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f96ac065250 0x7f96ac067700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0cf9a0 tx=0x7f96bc007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f8ade200640 1 -- 172.21.15.146:0/2406738876 shutdown_connections 2024-08-17T02:26:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f1dcdc00640 1 Processor -- start 2024-08-17T02:26:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29dc000fd0 con 0x7f2a040981f0 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f8ade200640 1 -- 172.21.15.146:0/2406738876 wait complete. 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400b2d0 con 0x7f5bec13e730 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400b430 con 0x7f5bec13e730 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400b7b0 con 0x7f5bec13e730 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f2b60a00640 1 -- 172.21.15.146:0/3084392167 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5002ae80 con 0x7f2b640aa810 2024-08-17T02:26:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f2b60a00640 1 -- 172.21.15.146:0/3084392167 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032650 con 0x7f2b640aa810 2024-08-17T02:26:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec12ad20 con 0x7f5bec13e730 2024-08-17T02:26:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.687+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec159e90 con 0x7f5bec13e730 2024-08-17T02:26:09.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.688+0000 7f1dcdc00640 1 -- start start 2024-08-17T02:26:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.688+0000 7f2b69200640 1 -- 172.21.15.146:0/3084392167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b640aa810 msgr2=0x7f2b640aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.688+0000 7f2b69200640 1 --2- 172.21.15.146:0/3084392167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b640aa810 0x7f2b640aac80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009850 tx=0x7f2b500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.688+0000 7f96d1000640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f96ac06d460 0x7f96ac06f870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bec15a080 con 0x7f5bec13e730 2024-08-17T02:26:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f2b69200640 1 -- 172.21.15.146:0/3084392167 shutdown_connections 2024-08-17T02:26:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f2b69200640 1 --2- 172.21.15.146:0/3084392167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b640aa810 0x7f2b640aac80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f2b69200640 1 -- 172.21.15.146:0/3084392167 >> 172.21.15.146:0/3084392167 conn(0x7f2b64096a70 msgr2=0x7f2b64096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f8ade200640 1 Processor -- start 2024-08-17T02:26:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f8ade200640 1 -- start start 2024-08-17T02:26:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== osd.1 v2:172.21.15.146:6800/37112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f96ac06ff20 con 0x7f96ac06d460 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29f4006b80 con 0x7f2a040981f0 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f29fb400640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f29e40652a0 0x7f29e4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29f40a38c0 con 0x7f2a040981f0 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f29fb400640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f29e406d4b0 0x7f29e406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.689+0000 7f2b69200640 1 -- 172.21.15.146:0/3084392167 shutdown_connections 2024-08-17T02:26:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8099c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 0x7f1dc8169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc80cc1b0 0x7f1dc808a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc809a160 con 0x7f1dc80cc1b0 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8088f60 con 0x7f1dc80a9490 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f1dcdc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8169cd0 con 0x7f1dc8068110 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 0x7f1dc8169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 0x7f1dc8169790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39912/0 (socket says 172.21.15.146:39912) 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 -- 172.21.15.146:0/3570508385 learned_addr learned my addr 172.21.15.146:0/3570508385 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc7400640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc80cc1b0 0x7f1dc808a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 -- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 msgr2=0x7f1dc8099c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1dc8068110 0x7f1dc8099c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 -- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc80cc1b0 msgr2=0x7f1dc808a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc80cc1b0 0x7f1dc808a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f1dc6000640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4009390 con 0x7f1dc80a9490 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80b1120 0x7f8ad80cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80b36e0 0x7f8ad8156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815d370 con 0x7f8ad80b36e0 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8158ab0 con 0x7f8ad80ada10 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f8ade200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad815cd20 con 0x7f8ad80b1120 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad815d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39898/0 (socket says 172.21.15.146:39898) 2024-08-17T02:26:09.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 -- 172.21.15.146:0/3757252358 learned_addr learned my addr 172.21.15.146:0/3757252358 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 -- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80b1120 msgr2=0x7f8ad80cc1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ad80b1120 0x7f8ad80cc1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.691+0000 7f8ad7400640 1 -- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80b36e0 msgr2=0x7f8ad8156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f8ad7e00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80b36e0 0x7f8ad8156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f8ad7400640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80b36e0 0x7f8ad8156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f8ad7400640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac8009450 con 0x7f8ad80ada10 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f8ad7e00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad80b36e0 0x7f8ad8156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f69a3a00640 1 Processor -- start 2024-08-17T02:26:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f2a03e00640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f29e40652a0 0x7f29e4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29e406ff70 con 0x7f29e406d4b0 2024-08-17T02:26:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29f40a3bf0 con 0x7f2a040981f0 2024-08-17T02:26:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f2b69200640 1 -- 172.21.15.146:0/3084392167 wait complete. 2024-08-17T02:26:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f8ad7400640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad815d800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8035040 tx=0x7f8ac8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f1dc6000640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 0x7f1dc8169790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0014780 tx=0x7f1dc0012cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f2b69200640 1 Processor -- start 2024-08-17T02:26:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f2b69200640 1 -- start start 2024-08-17T02:26:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.690+0000 7f69a3a00640 1 -- start start 2024-08-17T02:26:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f1dc7400640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc80cc1b0 0x7f1dc808a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00109f0 con 0x7f1dc80a9490 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f69a3a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f69a3a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 0x7f699c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f69a3a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c0b1690 con 0x7f699c15e140 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f69a3a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c0b1b20 con 0x7f699c15d830 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0010b50 con 0x7f1dc80a9490 2024-08-17T02:26:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00120d0 con 0x7f1dc80a9490 2024-08-17T02:26:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc80893f0 con 0x7f1dc80a9490 2024-08-17T02:26:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8031a60 con 0x7f8ad80ada10 2024-08-17T02:26:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.692+0000 7f69a3a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0ae4a0 con 0x7f699c0b0610 2024-08-17T02:26:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8031bc0 con 0x7f8ad80ada10 2024-08-17T02:26:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac803d440 con 0x7f8ad80ada10 2024-08-17T02:26:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f2a09200640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f29e406d4b0 0x7f29e406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f69a1000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad815d000 con 0x7f8ad80ada10 2024-08-17T02:26:09.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f69a1000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40254/0 (socket says 172.21.15.146:40254) 2024-08-17T02:26:09.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f69a1000640 1 -- 172.21.15.146:0/4215183898 learned_addr learned my addr 172.21.15.146:0/4215183898 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f6993e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 0x7f699c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.693+0000 7f69a1a00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f699c15e140 0x7f699c15e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48286/0 (socket says 172.21.15.146:48286) 2024-08-17T02:26:09.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.694+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad80cf920 con 0x7f8ad80ada10 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.694+0000 7f2b69200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b640aa810 0x7f2b6414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.694+0000 7f2b69200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b64157b20 0x7f2b64150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.694+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b640aa810 0x7f2b6414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.694+0000 7f2b69200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64165050 0x7f2b641505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b640aa810 0x7f2b6414f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40270/0 (socket says 172.21.15.146:40270) 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b61e00640 1 -- 172.21.15.146:0/69120150 learned_addr learned my addr 172.21.15.146:0/69120150 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f6993e00640 1 -- 172.21.15.146:0/4215183898 >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 msgr2=0x7f699c06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2a03e00640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f29e40652a0 0x7f29e4067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00b440 tx=0x7f29fc00b970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640afba0 con 0x7f2b640aa810 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640b22f0 con 0x7f2b64165050 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640af8c0 con 0x7f2b64157b20 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b62800640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64165050 0x7f2b641505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2b61400640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b64157b20 0x7f2b64150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ad815cba0 con 0x7f8ad80ada10 2024-08-17T02:26:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f6993e00640 1 --2- 172.21.15.146:0/4215183898 >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f6993e00640 1 -- 172.21.15.146:0/4215183898 >> v1:172.21.15.150:6789/0 conn(0x7f699c15e140 legacy=0x7f699c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f6993e00640 1 -- 172.21.15.146:0/4215183898 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c15b200 con 0x7f699c0b0610 2024-08-17T02:26:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f69a1000640 1 --2- 172.21.15.146:0/4215183898 >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:09.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f699be00640 1 -- 172.21.15.146:0/4215183898 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495724335 0 0) 0x7f699c0b1690 con 0x7f699c15e140 2024-08-17T02:26:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc8088630 con 0x7f1dc80a9490 2024-08-17T02:26:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.695+0000 7f2a09200640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f29e406d4b0 0x7f29e406f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f2b61400640 1 -- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64165050 msgr2=0x7f2b641505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8ac8039040 con 0x7f8ad80ada10 2024-08-17T02:26:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f2b61400640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64165050 0x7f2b641505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f2b61400640 1 -- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b640aa810 msgr2=0x7f2b6414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f2b61400640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b640aa810 0x7f2b6414f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.696+0000 7f2b61400640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009390 con 0x7f2b64157b20 2024-08-17T02:26:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== osd.3 v2:172.21.15.146:6824/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f29e406ff70 con 0x7f29e406d4b0 2024-08-17T02:26:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f2b62800640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b64165050 0x7f2b641505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5be403c040 con 0x7f5bec13e730 2024-08-17T02:26:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f6993e00640 1 --2- 172.21.15.146:0/4215183898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 0x7f699c15dc00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6984009850 tx=0x7f69840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c9c923ae42ff6a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f8acea00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8ab80652a0 0x7f8ab8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f2b61400640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b64157b20 0x7f2b64150090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b50031000 tx=0x7f2b50032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.697+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1dc8063d20 con 0x7f1dc80a9490 2024-08-17T02:26:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.698+0000 7f699be00640 1 -- 172.21.15.146:0/4215183898 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698402ad90 con 0x7f699c0b0610 2024-08-17T02:26:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.698+0000 7f699be00640 1 -- 172.21.15.146:0/4215183898 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984032440 con 0x7f699c0b0610 2024-08-17T02:26:09.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.698+0000 7f699be00640 1 -- 172.21.15.146:0/4215183898 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984032820 con 0x7f699c0b0610 2024-08-17T02:26:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.698+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1dc00124c0 con 0x7f1dc80a9490 2024-08-17T02:26:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032e00 con 0x7f2b64157b20 2024-08-17T02:26:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50031a60 con 0x7f2b64157b20 2024-08-17T02:26:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50031e20 con 0x7f2b64157b20 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f5be3400640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5bc80651d0 0x7f5bc8067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640b24e0 con 0x7f2b64157b20 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640b2aa0 con 0x7f2b64157b20 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5be40a2680 con 0x7f5bec13e730 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f5be3400640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7f5bc806d3e0 0x7f5bc806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bc806fea0 con 0x7f5bc806d3e0 2024-08-17T02:26:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5be40a4c20 con 0x7f5bec13e730 2024-08-17T02:26:09.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ac80a2430 con 0x7f8ad80ada10 2024-08-17T02:26:09.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f8acea00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7f8ab806d4b0 0x7f8ab806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ab806ff70 con 0x7f8ab806d4b0 2024-08-17T02:26:09.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ac80a49d0 con 0x7f8ad80ada10 2024-08-17T02:26:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f69a3a00640 1 -- 172.21.15.146:0/4215183898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 msgr2=0x7f699c15dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.699+0000 7f69a3a00640 1 --2- 172.21.15.146:0/4215183898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 0x7f699c15dc00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6984009850 tx=0x7f69840090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.700+0000 7f8ad6a00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8ab80652a0 0x7f8ab8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.700+0000 7f8ad7e00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7f8ab806d4b0 0x7f8ab806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.700+0000 7f5beb400640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5bc80651d0 0x7f5bc8067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.700+0000 7f5be2a00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7f5bc806d3e0 0x7f5bc806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.700+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b640ae5e0 con 0x7f2b64157b20 2024-08-17T02:26:09.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.701+0000 7f8ad6a00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8ab80652a0 0x7f8ab8067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ad815dd60 tx=0x7f8ac4006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.701+0000 7f1dbe000640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1da8065250 0x7f1da8067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.701+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1dc008a630 con 0x7f1dc80a9490 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.701+0000 7f1dbe000640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f1da806d460 0x7f1da806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1da806ff20 con 0x7f1da806d460 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc008cb90 con 0x7f1dc80a9490 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 -- 172.21.15.146:0/4215183898 shutdown_connections 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 --2- 172.21.15.146:0/4215183898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c0b0610 0x7f699c15dc00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 --2- 172.21.15.146:0/4215183898 >> v2:172.21.15.146:3300/0 conn(0x7f699c15d830 0x7f699c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 -- 172.21.15.146:0/4215183898 >> 172.21.15.146:0/4215183898 conn(0x7f699c0cb9b0 msgr2=0x7f699c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f8ad7e00640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7f8ab806d4b0 0x7f8ab806f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f1dc7400640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f1da806d460 0x7f1da806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 -- 172.21.15.146:0/4215183898 shutdown_connections 2024-08-17T02:26:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f69a3a00640 1 -- 172.21.15.146:0/4215183898 wait complete. 2024-08-17T02:26:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.703+0000 7f1dc7400640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f1da806d460 0x7f1da806f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.703+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== osd.6 v2:172.21.15.150:6816/37543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8ab806ff70 con 0x7f8ab806d4b0 2024-08-17T02:26:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.703+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b50039040 con 0x7f2b64157b20 2024-08-17T02:26:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f5be2a00640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7f5bc806d3e0 0x7f5bc806f7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.702+0000 7f5beb400640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5bc80651d0 0x7f5bc8067680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc004160 tx=0x7f5bdc0026c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f1dc6a00640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1da8065250 0x7f1da8067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== osd.5 v2:172.21.15.150:6824/37542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f1da806ff20 con 0x7f1da806d460 2024-08-17T02:26:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== osd.2 v2:172.21.15.146:6816/37117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5bc806fea0 con 0x7f5bc806d3e0 2024-08-17T02:26:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f69a3a00640 1 Processor -- start 2024-08-17T02:26:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f69a3a00640 1 -- start start 2024-08-17T02:26:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f1dc6a00640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1da8065250 0x7f1da8067700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005840 tx=0x7f1db8007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f2b59600640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b44065220 0x7f2b440676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.704+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b500a2bd0 con 0x7f2b64157b20 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.705+0000 7f2b59600640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f2b4406d430 0x7f2b4406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.705+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b4406fef0 con 0x7f2b4406d430 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.705+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b500a7240 con 0x7f2b64157b20 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.705+0000 7f2b62800640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f2b4406d430 0x7f2b4406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.705+0000 7f2b61e00640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b44065220 0x7f2b440676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 0x7f699c0a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f699c15d830 0x7f699c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c15e140 0x7f699c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0aa060 con 0x7f699c15d830 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0a8b60 con 0x7f699c0b0610 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.706+0000 7f69a3a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0a9450 con 0x7f699c15e140 2024-08-17T02:26:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 0x7f699c0a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 0x7f699c0a8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39928/0 (socket says 172.21.15.146:39928) 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 -- 172.21.15.146:0/2346748894 learned_addr learned my addr 172.21.15.146:0/2346748894 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c15e140 0x7f699c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 -- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c15e140 msgr2=0x7f699c06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f699c15e140 0x7f699c06d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 -- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f699c15d830 msgr2=0x7f699c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f699c15d830 0x7f699c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f69a1000640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c009ae0 con 0x7f699c0b0610 2024-08-17T02:26:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.707+0000 7f2b62800640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f2b4406d430 0x7f2b4406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.708+0000 7f2b61e00640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b44065220 0x7f2b440676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b54001860 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.708+0000 7f69a1000640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 0x7f699c0a8620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c170 tx=0x7f698c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0090d0 con 0x7f699c0b0610 2024-08-17T02:26:09.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== osd.4 v2:172.21.15.150:6808/37541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2b4406fef0 con 0x7f2b4406d430 2024-08-17T02:26:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c00f040 con 0x7f699c0b0610 2024-08-17T02:26:09.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6984009390 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0146b0 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.709+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c0a9a10 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.711+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f699c064db0 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.713+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f698c014a20 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.714+0000 7f6998c00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6978065250 0x7f6978067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.714+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f698c082c20 con 0x7f699c0b0610 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.714+0000 7f6998c00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7f697806d3e0 0x7f697806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.715+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 --> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96cc0cbaf0 con 0x7f96ac06d460 2024-08-17T02:26:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.715+0000 7f96c3400640 1 -- 172.21.15.146:0/2453205473 <== osd.1 v2:172.21.15.146:6800/37112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96cc0cbaf0 con 0x7f96ac06d460 2024-08-17T02:26:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.716+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f96ac06d460 msgr2=0x7f96ac06f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.716+0000 7f96d1a00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f96ac06d460 0x7f96ac06f870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 --> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90cc0e58a0 con 0x7f90b406d430 2024-08-17T02:26:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f96ac065250 msgr2=0x7f96ac067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f96d1a00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f96ac065250 0x7f96ac067700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0cf9a0 tx=0x7f96bc007ed0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.715+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f697806fea0 con 0x7f697806d3e0 2024-08-17T02:26:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.715+0000 7f6993e00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6978065250 0x7f6978067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f6993e00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6978065250 0x7f6978067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6984034000 tx=0x7f6984032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc0cc9d0 msgr2=0x7f96cc1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.717+0000 7f96d1a00640 1 --2- 172.21.15.146:0/2453205473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96cc0cc9d0 0x7f96cc1550a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b8031000 tx=0x7f96b8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f96d1000640 1 -- 172.21.15.146:0/2453205473 reap_dead start 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 shutdown_connections 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 >> 172.21.15.146:0/2453205473 conn(0x7f96cc098e30 msgr2=0x7f96cc156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 shutdown_connections 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f698c050cc0 con 0x7f699c0b0610 2024-08-17T02:26:09.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f69a1a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7f697806d3e0 0x7f697806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.719+0000 7f90c6a00640 1 -- 172.21.15.146:0/1655401848 <== osd.0 v2:172.21.15.146:6808/37113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90cc0e58a0 con 0x7f90b406d430 2024-08-17T02:26:09.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.718+0000 7f96d1a00640 1 -- 172.21.15.146:0/2453205473 wait complete. 2024-08-17T02:26:09.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.719+0000 7f69a1a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7f697806d3e0 0x7f697806f7f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.720+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f90b406d430 msgr2=0x7f90b406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.720+0000 7f90d9200640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f90b406d430 0x7f90b406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.720+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== osd.7 v2:172.21.15.150:6800/37540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f697806fea0 con 0x7f697806d3e0 2024-08-17T02:26:09.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f90b4065220 msgr2=0x7f90b40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f90b4065220 0x7f90b40676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90c8010500 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90cc04bb40 msgr2=0x7f90cc04bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 --2- 172.21.15.146:0/1655401848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90cc04bb40 0x7f90cc04bfb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90d402ae30 tx=0x7f90d40aa000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d3e00640 1 -- 172.21.15.146:0/1655401848 reap_dead start 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 shutdown_connections 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 >> 172.21.15.146:0/1655401848 conn(0x7f90cc00a7d0 msgr2=0x7f90cc007ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 shutdown_connections 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.724+0000 7f90d9200640 1 -- 172.21.15.146:0/1655401848 wait complete. 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.726+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 --> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5bec064670 con 0x7f5bc806d3e0 2024-08-17T02:26:09.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.726+0000 7f5be3400640 1 -- 172.21.15.146:0/13894393 <== osd.2 v2:172.21.15.146:6816/37117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5bd4001970 con 0x7f5bc806d3e0 2024-08-17T02:26:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7f5bc806d3e0 msgr2=0x7f5bc806f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7f5bc806d3e0 0x7f5bc806f7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5bc80651d0 msgr2=0x7f5bc8067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5bc80651d0 0x7f5bc8067680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc004160 tx=0x7f5bdc0026c0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec13e730 msgr2=0x7f5bec15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bf2600640 1 --2- 172.21.15.146:0/13894393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bec13e730 0x7f5bec15fa80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5be4034000 tx=0x7f5be403a000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.728+0000 7f5bebe00640 1 -- 172.21.15.146:0/13894393 reap_dead start 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.729+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 shutdown_connections 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.729+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 >> 172.21.15.146:0/13894393 conn(0x7f5bec0cc480 msgr2=0x7f5bec13d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.733+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 shutdown_connections 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.733+0000 7f5bf2600640 1 -- 172.21.15.146:0/13894393 wait complete. 2024-08-17T02:26:09.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.737+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 --> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1dc81591f0 con 0x7f1da806d460 2024-08-17T02:26:09.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.737+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 --> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ad815ce60 con 0x7f8ab806d4b0 2024-08-17T02:26:09.763 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2024-08-17T02:26:09.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.738+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 --> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29dc002ca0 con 0x7f29e406d4b0 2024-08-17T02:26:09.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.738+0000 7f1dbe000640 1 -- 172.21.15.146:0/3570508385 <== osd.5 v2:172.21.15.150:6824/37542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1dc81591f0 con 0x7f1da806d460 2024-08-17T02:26:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.738+0000 7f29fb400640 1 -- 172.21.15.146:0/2441329701 <== osd.3 v2:172.21.15.146:6824/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29dc002ca0 con 0x7f29e406d4b0 2024-08-17T02:26:09.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.738+0000 7f8acea00640 1 -- 172.21.15.146:0/3757252358 <== osd.6 v2:172.21.15.150:6816/37543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ad815ce60 con 0x7f8ab806d4b0 2024-08-17T02:26:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f29e406d4b0 msgr2=0x7f29e406f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f2a0b200640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f29e406d4b0 0x7f29e406f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7f8ab806d4b0 msgr2=0x7f8ab806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f1da806d460 msgr2=0x7f1da806f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f1da806d460 0x7f1da806f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f8ade200640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7f8ab806d4b0 0x7f8ab806f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1da8065250 msgr2=0x7f1da8067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8ab80652a0 msgr2=0x7f8ab8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8ab80652a0 0x7f8ab8067750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8ad815dd60 tx=0x7f8ac4006ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 msgr2=0x7f8ad815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 --2- 172.21.15.146:0/3757252358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ad80ada10 0x7f8ad815d800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8035040 tx=0x7f8ac8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ad7e00640 1 -- 172.21.15.146:0/3757252358 reap_dead start 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1da8065250 0x7f1da8067700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005840 tx=0x7f1db8007a30 comp rx=0 tx=0).stop 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 msgr2=0x7f1dc8169790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 --2- 172.21.15.146:0/3570508385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1dc80a9490 0x7f1dc8169790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0014780 tx=0x7f1dc0012cf0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dc7400640 1 -- 172.21.15.146:0/3570508385 reap_dead start 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 shutdown_connections 2024-08-17T02:26:09.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 >> 172.21.15.146:0/3757252358 conn(0x7f8ad80cfdf0 msgr2=0x7f8ad80688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 --> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b64064db0 con 0x7f2b4406d430 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 shutdown_connections 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 >> 172.21.15.146:0/3570508385 conn(0x7f1dc80afca0 msgr2=0x7f1dc80ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f29e40652a0 msgr2=0x7f29e4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.739+0000 7f2a0b200640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f29e40652a0 0x7f29e4067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00b440 tx=0x7f29fc00b970 comp rx=0 tx=0).stop 2024-08-17T02:26:09.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 msgr2=0x7f2a04153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a0b200640 1 --2- 172.21.15.146:0/2441329701 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a040981f0 0x7f2a04153250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29f4000fd0 tx=0x7f29f4035000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a09200640 1 -- 172.21.15.146:0/2441329701 reap_dead start 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 shutdown_connections 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 >> 172.21.15.146:0/2441329701 conn(0x7f2a040b3040 msgr2=0x7f2a040b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 shutdown_connections 2024-08-17T02:26:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 shutdown_connections 2024-08-17T02:26:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f1dcdc00640 1 -- 172.21.15.146:0/3570508385 wait complete. 2024-08-17T02:26:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f8ade200640 1 -- 172.21.15.146:0/3757252358 wait complete. 2024-08-17T02:26:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2b59600640 1 -- 172.21.15.146:0/69120150 <== osd.4 v2:172.21.15.150:6808/37541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b64064db0 con 0x7f2b4406d430 2024-08-17T02:26:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.740+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 shutdown_connections 2024-08-17T02:26:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.741+0000 7f2a0b200640 1 -- 172.21.15.146:0/2441329701 wait complete. 2024-08-17T02:26:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.741+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f2b4406d430 msgr2=0x7f2b4406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.741+0000 7f2b69200640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f2b4406d430 0x7f2b4406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b44065220 msgr2=0x7f2b440676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b44065220 0x7f2b440676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b54001860 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b64157b20 msgr2=0x7f2b64150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 --2- 172.21.15.146:0/69120150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b64157b20 0x7f2b64150090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2b50031000 tx=0x7f2b50032000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b62800640 1 -- 172.21.15.146:0/69120150 reap_dead start 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 shutdown_connections 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 >> 172.21.15.146:0/69120150 conn(0x7f2b64096a70 msgr2=0x7f2b6406b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 shutdown_connections 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.742+0000 7f2b69200640 1 -- 172.21.15.146:0/69120150 wait complete. 2024-08-17T02:26:09.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.748+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 --> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f699c0ae280 con 0x7f697806d3e0 2024-08-17T02:26:09.774 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:09.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:09.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.749+0000 7f6998c00640 1 -- 172.21.15.146:0/2346748894 <== osd.7 v2:172.21.15.150:6800/37540 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f699c0ae280 con 0x7f697806d3e0 2024-08-17T02:26:09.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7f697806d3e0 msgr2=0x7f697806f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7f697806d3e0 0x7f697806f7f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6978065250 msgr2=0x7f6978067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6978065250 0x7f6978067700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6984034000 tx=0x7f6984032000 comp rx=0 tx=0).stop 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 msgr2=0x7f699c0a8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 --2- 172.21.15.146:0/2346748894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f699c0b0610 0x7f699c0a8620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f698c00c170 tx=0x7f698c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a1a00640 1 -- 172.21.15.146:0/2346748894 reap_dead start 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 shutdown_connections 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 >> 172.21.15.146:0/2346748894 conn(0x7f699c0cb9b0 msgr2=0x7f699c1498a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 shutdown_connections 2024-08-17T02:26:09.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:09.750+0000 7f69a3a00640 1 -- 172.21.15.146:0/2346748894 wait complete. 2024-08-17T02:26:09.777 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:09.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:09.778 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:09.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:09.779 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:09.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:09.780 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-08-17T02:26:09.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:09.781 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-08-17T02:26:09.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:09.782 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:09.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.073+0000 7f5903e00640 1 Processor -- start 2024-08-17T02:26:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.073+0000 7f5903e00640 1 -- start start 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.072+0000 7ff31a000640 1 Processor -- start 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.072+0000 7ff31a000640 1 -- start start 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.074+0000 7ff31a000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff31406dc80 0x7ff3140ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.074+0000 7ff31a000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140b0970 con 0x7ff3140cb1d0 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.074+0000 7ff31a000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140b0c50 con 0x7ff3140cae00 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.074+0000 7ff31a000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140b0f30 con 0x7ff31406dc80 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7ff312a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff31406dc80 0x7ff3140ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7ff313400640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff3140cae00 0x7ff31406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48292/0 (socket says 172.21.15.146:48292) 2024-08-17T02:26:10.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7ff313400640 1 -- 172.21.15.146:0/2073533603 learned_addr learned my addr 172.21.15.146:0/2073533603 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7f5903e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58fc0dead0 0x7f58fc053da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7f5903e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 0x7f58fc0554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7f5903e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0df2f0 con 0x7f58fc050fb0 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7f5903e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc055020 con 0x7f58fc0dead0 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.075+0000 7f5903e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc054410 con 0x7f58fc0deea0 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.076+0000 7ff312a00640 1 -- 172.21.15.146:0/2073533603 >> v1:172.21.15.150:6789/0 conn(0x7ff3140cae00 legacy=0x7ff31406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.076+0000 7ff312a00640 1 -- 172.21.15.146:0/2073533603 >> v1:172.21.15.146:6789/0 conn(0x7ff3140cb1d0 legacy=0x7ff314156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.076+0000 7ff312a00640 1 -- 172.21.15.146:0/2073533603 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140b1210 con 0x7ff31406dc80 2024-08-17T02:26:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.077+0000 7f6680a00640 1 Processor -- start 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.076+0000 7f5902a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58fc0dead0 0x7f58fc053da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.077+0000 7f5902a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58fc0dead0 0x7f58fc053da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40292/0 (socket says 172.21.15.146:40292) 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.077+0000 7f5902a00640 1 -- 172.21.15.146:0/3241989677 learned_addr learned my addr 172.21.15.146:0/3241989677 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.077+0000 7f5902a00640 1 -- 172.21.15.146:0/3241989677 >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 msgr2=0x7f58fc0554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.076+0000 7f5902000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 0x7f58fc0554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.078+0000 7f5902a00640 1 --2- 172.21.15.146:0/3241989677 >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 0x7f58fc0554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.078+0000 7f5902a00640 1 -- 172.21.15.146:0/3241989677 >> v1:172.21.15.150:6789/0 conn(0x7f58fc050fb0 legacy=0x7f58fc0e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.078+0000 7f5902a00640 1 -- 172.21.15.146:0/3241989677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0546f0 con 0x7f58fc0dead0 2024-08-17T02:26:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.078+0000 7f5902000640 1 --2- 172.21.15.146:0/3241989677 >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 0x7f58fc0554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:10.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.079+0000 7f5902a00640 1 --2- 172.21.15.146:0/3241989677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc0dead0 0x7f58fc053da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58fc03bca0 tx=0x7f58f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bacf700c2a1284 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7f6680a00640 1 -- start start 2024-08-17T02:26:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7f5901600640 1 -- 172.21.15.146:0/3241989677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f403a480 con 0x7f58fc0dead0 2024-08-17T02:26:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7f5901600640 1 -- 172.21.15.146:0/3241989677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f403a5e0 con 0x7f58fc0dead0 2024-08-17T02:26:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7f5901600640 1 -- 172.21.15.146:0/3241989677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f403a9c0 con 0x7f58fc0dead0 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.078+0000 7ff312a00640 1 --2- 172.21.15.146:0/2073533603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff3140ae800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff300007250 tx=0x7ff30000ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=224ec56f39cd8593 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.079+0000 7ff312000640 1 -- 172.21.15.146:0/2073533603 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30002be40 con 0x7ff31406dc80 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.079+0000 7ff312000640 1 -- 172.21.15.146:0/2073533603 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000089e0 con 0x7ff31406dc80 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.079+0000 7ff312000640 1 -- 172.21.15.146:0/2073533603 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30002be40 con 0x7ff31406dc80 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 -- 172.21.15.146:0/2073533603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 msgr2=0x7ff3140ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 --2- 172.21.15.146:0/2073533603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff3140ae800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff300007250 tx=0x7ff30000ab40 comp rx=0 tx=0).stop 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 -- 172.21.15.146:0/2073533603 shutdown_connections 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 --2- 172.21.15.146:0/2073533603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff3140ae800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 -- 172.21.15.146:0/2073533603 >> 172.21.15.146:0/2073533603 conn(0x7ff314067750 msgr2=0x7ff3140cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 -- 172.21.15.146:0/2073533603 shutdown_connections 2024-08-17T02:26:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.080+0000 7ff31a000640 1 -- 172.21.15.146:0/2073533603 wait complete. 2024-08-17T02:26:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.082+0000 7f6680a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6674034480 0x7f66740e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.082+0000 7f6680a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740338e0 con 0x7f66740d95c0 2024-08-17T02:26:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.082+0000 7f6680a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740e3140 con 0x7f66740d91f0 2024-08-17T02:26:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.082+0000 7f6680a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66740e39e0 con 0x7f6674034480 2024-08-17T02:26:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.082+0000 7ff31a000640 1 Processor -- start 2024-08-17T02:26:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.083+0000 7ff31a000640 1 -- start start 2024-08-17T02:26:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.083+0000 7f667a800640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f66740d91f0 0x7f66740dfe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48306/0 (socket says 172.21.15.146:48306) 2024-08-17T02:26:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.083+0000 7f667a800640 1 -- 172.21.15.146:0/828723236 learned_addr learned my addr 172.21.15.146:0/828723236 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.083+0000 7f667b200640 1 --2- 172.21.15.146:0/828723236 >> v2:172.21.15.146:3300/0 conn(0x7f6674034480 0x7f66740e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309255870 0 0) 0x7f66740e3140 con 0x7f66740d91f0 2024-08-17T02:26:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f5903e00640 1 -- 172.21.15.146:0/3241989677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc0dead0 msgr2=0x7f58fc053da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f5903e00640 1 --2- 172.21.15.146:0/3241989677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc0dead0 0x7f58fc053da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58fc03bca0 tx=0x7f58f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66600056f0 con 0x7f66740d91f0 2024-08-17T02:26:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476394261 0 0) 0x7f66740338e0 con 0x7f66740d95c0 2024-08-17T02:26:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66740e3140 con 0x7f66740d95c0 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3140cae00 0x7ff31415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3140cb1d0 0x7ff314159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff314159be0 con 0x7ff3140cae00 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31415d270 con 0x7ff31406dc80 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7ff31a000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31415d550 con 0x7ff3140cb1d0 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39946/0 (socket says 172.21.15.146:39946) 2024-08-17T02:26:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 -- 172.21.15.146:0/3577347996 learned_addr learned my addr 172.21.15.146:0/3577347996 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 -- 172.21.15.146:0/3241989677 shutdown_connections 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 --2- 172.21.15.146:0/3241989677 >> v2:172.21.15.150:3300/0 conn(0x7f58fc0deea0 0x7f58fc0554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 --2- 172.21.15.146:0/3241989677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc0dead0 0x7f58fc053da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 -- 172.21.15.146:0/3241989677 >> 172.21.15.146:0/3241989677 conn(0x7f58fc055ca0 msgr2=0x7f58fc0560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f667b200640 1 -- 172.21.15.146:0/828723236 >> v1:172.21.15.150:6789/0 conn(0x7f66740d91f0 legacy=0x7f66740dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f667b200640 1 -- 172.21.15.146:0/828723236 >> v1:172.21.15.146:6789/0 conn(0x7f66740d95c0 legacy=0x7f6674033d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.084+0000 7f667b200640 1 -- 172.21.15.146:0/828723236 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740e3420 con 0x7f6674034480 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 -- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3140cb1d0 msgr2=0x7ff314159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3140cb1d0 0x7ff314159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 -- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3140cae00 msgr2=0x7ff31415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3140cae00 0x7ff31415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7ff313400640 1 -- 172.21.15.146:0/3577347996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30000adc0 con 0x7ff31406dc80 2024-08-17T02:26:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 -- 172.21.15.146:0/3241989677 shutdown_connections 2024-08-17T02:26:10.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.085+0000 7f5903e00640 1 -- 172.21.15.146:0/3241989677 wait complete. 2024-08-17T02:26:10.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.086+0000 7ff313400640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c590 tx=0x7ff304007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.086+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304005aa0 con 0x7ff31406dc80 2024-08-17T02:26:10.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.086+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304005c20 con 0x7ff31406dc80 2024-08-17T02:26:10.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040070f0 con 0x7ff31406dc80 2024-08-17T02:26:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31415d830 con 0x7ff31406dc80 2024-08-17T02:26:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7f667b200640 1 --2- 172.21.15.146:0/828723236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6674034480 0x7f66740e29f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f667c04c0c0 tx=0x7f667c06f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68190368e425ba6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31413b3c0 con 0x7ff31406dc80 2024-08-17T02:26:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7f5903e00640 1 Processor -- start 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.087+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c001470 con 0x7f6674034480 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.088+0000 7f5903e00640 1 -- start start 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 0x7f58fc0f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58fc0dead0 0x7f58fc0d7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc0d3320 con 0x7f58fc050fb0 2024-08-17T02:26:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc04fa70 con 0x7f58fc0deea0 2024-08-17T02:26:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f5903e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc04ee60 con 0x7f58fc0dead0 2024-08-17T02:26:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0a4050 con 0x7f6674034480 2024-08-17T02:26:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7f6679400640 1 -- 172.21.15.146:0/828723236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0a8610 con 0x7f6674034480 2024-08-17T02:26:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f5903400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f5902000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58fc0dead0 0x7f58fc0d7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f5903400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39962/0 (socket says 172.21.15.146:39962) 2024-08-17T02:26:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f5903400640 1 -- 172.21.15.146:0/377400369 learned_addr learned my addr 172.21.15.146:0/377400369 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f5902a00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 0x7f58fc0f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.089+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff314071050 con 0x7ff31406dc80 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7f5903400640 1 -- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58fc0dead0 msgr2=0x7f58fc0d7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7f5903400640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58fc0dead0 0x7f58fc0d7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7f5903400640 1 -- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 msgr2=0x7f58fc0f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff304007540 con 0x7ff31406dc80 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7f5903400640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 0x7f58fc0f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.091+0000 7f5903400640 1 -- 172.21.15.146:0/377400369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40107d0 con 0x7f58fc0deea0 2024-08-17T02:26:10.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f5902a00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 0x7f58fc0f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f6680a00640 1 -- 172.21.15.146:0/828723236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6674034480 msgr2=0x7f66740e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f6680a00640 1 --2- 172.21.15.146:0/828723236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6674034480 0x7f66740e29f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f667c04c0c0 tx=0x7f667c06f710 comp rx=0 tx=0).stop 2024-08-17T02:26:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f157f800640 1 Processor -- start 2024-08-17T02:26:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.090+0000 7f157f800640 1 -- start start 2024-08-17T02:26:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f5903400640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f590404c0c0 tx=0x7f590406f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7ff30aa00640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 0x7ff2f4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f157f800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15780b1120 0x7f15780aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7f157f800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780d0ab0 con 0x7f15780ada10 2024-08-17T02:26:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7f157f800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780b00c0 con 0x7f15780b3370 2024-08-17T02:26:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7f157f800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780af330 con 0x7f15780b1120 2024-08-17T02:26:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff304081870 con 0x7ff31406dc80 2024-08-17T02:26:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.092+0000 7fe5d4200640 1 Processor -- start 2024-08-17T02:26:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7f157ce00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f15780ada10 0x7f15780b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55890/0 (socket says 172.21.15.146:55890) 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7f157ce00640 1 -- 172.21.15.146:0/2365773444 learned_addr learned my addr 172.21.15.146:0/2365773444 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7f1577e00640 1 --2- 172.21.15.146:0/2365773444 >> v2:172.21.15.146:3300/0 conn(0x7f15780b1120 0x7f15780aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7ff312a00640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 0x7ff2f4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f1577e00640 1 -- 172.21.15.146:0/2365773444 >> v1:172.21.15.150:6789/0 conn(0x7f15780b3370 legacy=0x7f15781629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f1577e00640 1 -- 172.21.15.146:0/2365773444 >> v1:172.21.15.146:6789/0 conn(0x7f15780ada10 legacy=0x7f15780b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f1577e00640 1 -- 172.21.15.146:0/2365773444 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780b0360 con 0x7f15780b1120 2024-08-17T02:26:10.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.093+0000 7fe5d4200640 1 -- start start 2024-08-17T02:26:10.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f1179600640 1 Processor -- start 2024-08-17T02:26:10.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7ff312a00640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 0x7ff2f4067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff300034000 tx=0x7ff300035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f6680a00640 1 -- 172.21.15.146:0/828723236 shutdown_connections 2024-08-17T02:26:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f6680a00640 1 --2- 172.21.15.146:0/828723236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6674034480 0x7f66740e29f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.094+0000 7f6680a00640 1 -- 172.21.15.146:0/828723236 >> 172.21.15.146:0/828723236 conn(0x7f6674009fa0 msgr2=0x7f667400a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f37a0400640 1 Processor -- start 2024-08-17T02:26:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f1179600640 1 -- start start 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d4200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5cc13e360 0x7fe5cc0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d4200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5cc13e730 0x7fe5cc069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d4200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5cc0af6e0 con 0x7fe5cc06a410 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d4200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0acb40 con 0x7fe5cc13e360 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d4200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0ad6c0 con 0x7fe5cc13e730 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d2200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe5cc06a410 0x7fe5cc0aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55900/0 (socket says 172.21.15.146:55900) 2024-08-17T02:26:10.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7fe5d2200640 1 -- 172.21.15.146:0/3508331403 learned_addr learned my addr 172.21.15.146:0/3508331403 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f6680a00640 1 -- 172.21.15.146:0/828723236 shutdown_connections 2024-08-17T02:26:10.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f6680a00640 1 -- 172.21.15.146:0/828723236 wait complete. 2024-08-17T02:26:10.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f37a0400640 1 -- start start 2024-08-17T02:26:10.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.095+0000 7f1577e00640 1 --2- 172.21.15.146:0/2365773444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780b1120 0x7f15780aedf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1564009850 tx=0x7f15640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7076a92ebae16e8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7fe5d1800640 1 --2- 172.21.15.146:0/3508331403 >> v2:172.21.15.146:3300/0 conn(0x7fe5cc13e360 0x7fe5cc0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7fe5cbe00640 1 -- 172.21.15.146:0/3508331403 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576094676 0 0) 0x7fe5cc0af6e0 con 0x7fe5cc06a410 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7fe5cbe00640 1 -- 172.21.15.146:0/3508331403 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b40034e0 con 0x7fe5cc06a410 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f1577400640 1 -- 172.21.15.146:0/2365773444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156402ae20 con 0x7f15780b1120 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f1577400640 1 -- 172.21.15.146:0/2365773444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564032440 con 0x7f15780b1120 2024-08-17T02:26:10.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f1577400640 1 -- 172.21.15.146:0/2365773444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564032820 con 0x7f15780b1120 2024-08-17T02:26:10.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590406f470 con 0x7f58fc0deea0 2024-08-17T02:26:10.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590408f3b0 con 0x7f58fc0deea0 2024-08-17T02:26:10.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590408f770 con 0x7f58fc0deea0 2024-08-17T02:26:10.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc04f140 con 0x7f58fc0deea0 2024-08-17T02:26:10.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc04f700 con 0x7f58fc0deea0 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1179600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 0x7f11740aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1179600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11740ac3d0 0x7f11740ac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1179600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740ab1d0 con 0x7f11740b0130 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1179600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740acd90 con 0x7f11740ac3d0 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1179600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740af8a0 con 0x7f117415d1c0 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f116be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f11740b0130 0x7f11740ab660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55910/0 (socket says 172.21.15.146:55910) 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f116be00640 1 -- 172.21.15.146:0/1910988366 learned_addr learned my addr 172.21.15.146:0/1910988366 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f1173400640 1 --2- 172.21.15.146:0/1910988366 >> v2:172.21.15.150:3300/0 conn(0x7f11740ac3d0 0x7f11740ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f37a0400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37980b0610 0x7f379815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f37a0400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f37a0400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37980b1690 con 0x7f379815d830 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f37a0400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379806e8c0 con 0x7f37980b0610 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f37a0400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37980b1b20 con 0x7f379815e140 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.096+0000 7fe5d0e00640 1 --2- 172.21.15.146:0/3508331403 >> v2:172.21.15.150:3300/0 conn(0x7fe5cc13e730 0x7fe5cc069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7fe5d1800640 1 -- 172.21.15.146:0/3508331403 >> v2:172.21.15.150:3300/0 conn(0x7fe5cc13e730 msgr2=0x7fe5cc069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7fe5d1800640 1 --2- 172.21.15.146:0/3508331403 >> v2:172.21.15.150:3300/0 conn(0x7fe5cc13e730 0x7fe5cc069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7fe5d1800640 1 -- 172.21.15.146:0/3508331403 >> v1:172.21.15.146:6789/0 conn(0x7fe5cc06a410 legacy=0x7fe5cc0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7fe5d1800640 1 -- 172.21.15.146:0/3508331403 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc06a810 con 0x7fe5cc13e360 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f1172a00640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 0x7f11740aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37980b0610 0x7f379815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379da00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f379815d830 0x7f379806e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48332/0 (socket says 172.21.15.146:48332) 2024-08-17T02:26:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f6680a00640 1 Processor -- start 2024-08-17T02:26:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37980b0610 0x7f379815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39990/0 (socket says 172.21.15.146:39990) 2024-08-17T02:26:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379da00640 1 -- 172.21.15.146:0/3034112173 learned_addr learned my addr 172.21.15.146:0/3034112173 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379e400640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f157f800640 1 -- 172.21.15.146:0/2365773444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780b1120 msgr2=0x7f15780aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f157f800640 1 --2- 172.21.15.146:0/2365773444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780b1120 0x7f15780aedf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1564009850 tx=0x7f15640090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f157f800640 1 -- 172.21.15.146:0/2365773444 shutdown_connections 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f157f800640 1 --2- 172.21.15.146:0/2365773444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780b1120 0x7f15780aedf0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1564009850 tx=0x7f15640090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.097+0000 7f157f800640 1 -- 172.21.15.146:0/2365773444 >> 172.21.15.146:0/2365773444 conn(0x7f15780cfdf0 msgr2=0x7f15780d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858946878 0 0) 0x7f11740ab1d0 con 0x7f11740b0130 2024-08-17T02:26:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11580034e0 con 0x7f11740b0130 2024-08-17T02:26:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f6680a00640 1 -- start start 2024-08-17T02:26:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff30404f990 con 0x7ff31406dc80 2024-08-17T02:26:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 -- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 msgr2=0x7f3798166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798166e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 -- 172.21.15.146:0/3034112173 >> v1:172.21.15.150:6789/0 conn(0x7f379815d830 legacy=0x7f379806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f379d000640 1 -- 172.21.15.146:0/3034112173 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980ae4a0 con 0x7f37980b0610 2024-08-17T02:26:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.098+0000 7f1173400640 1 -- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 msgr2=0x7f11740aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f157f800640 1 -- 172.21.15.146:0/2365773444 shutdown_connections 2024-08-17T02:26:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775740661 0 0) 0x7f11580034e0 con 0x7f11740b0130 2024-08-17T02:26:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f590408fb60 con 0x7f58fc0deea0 2024-08-17T02:26:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc005770 con 0x7f58fc0deea0 2024-08-17T02:26:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.100+0000 7f6680a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6674034480 0x7f66740dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f1173400640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 0x7f11740aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f1173400640 1 -- 172.21.15.146:0/1910988366 >> v1:172.21.15.146:6789/0 conn(0x7f11740b0130 legacy=0x7f11740ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.099+0000 7f1173400640 1 -- 172.21.15.146:0/1910988366 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740abd70 con 0x7f11740ac3d0 2024-08-17T02:26:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.100+0000 7f6680a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 0x7f66740d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.100+0000 7fe5d1800640 1 --2- 172.21.15.146:0/3508331403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc13e360 0x7fe5cc0adb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0706f0 tx=0x7fe5c000a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892244192cc2d26f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.100+0000 7f1172a00640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 0x7f11740aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f6680a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f6680a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740e1830 con 0x7f66740d91f0 2024-08-17T02:26:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f1173400640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11740ac3d0 0x7f11740ac850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f116c009850 tx=0x7f116c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8faa3e39250f8662 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7fe5cbe00640 1 -- 172.21.15.146:0/3508331403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0030040 con 0x7fe5cc13e360 2024-08-17T02:26:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f6680a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667404fea0 con 0x7f66740d95c0 2024-08-17T02:26:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f6680a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740e0f90 con 0x7f6674034480 2024-08-17T02:26:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f58fa000640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 0x7f58e4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59040f8de0 con 0x7f58fc0deea0 2024-08-17T02:26:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f667b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f667b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:39992/0 (socket says 172.21.15.146:39992) 2024-08-17T02:26:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f667b200640 1 -- 172.21.15.146:0/3036994419 learned_addr learned my addr 172.21.15.146:0/3036994419 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7fe5cbe00640 1 -- 172.21.15.146:0/3508331403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c0034610 con 0x7fe5cc13e360 2024-08-17T02:26:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7fe5cbe00640 1 -- 172.21.15.146:0/3508331403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00349f0 con 0x7fe5cc13e360 2024-08-17T02:26:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.100+0000 7f157f800640 1 -- 172.21.15.146:0/2365773444 wait complete. 2024-08-17T02:26:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f5902a00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 0x7f58e4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.101+0000 7f667a800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6674034480 0x7f66740dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f6679e00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 0x7f66740d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f379d000640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379815dc00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3784009880 tx=0x7f37840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba087b841dd206c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f157f800640 1 Processor -- start 2024-08-17T02:26:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f667b200640 1 -- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6674034480 msgr2=0x7f66740dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f667b200640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6674034480 0x7f66740dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f667b200640 1 -- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 msgr2=0x7f66740d85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f157f800640 1 -- start start 2024-08-17T02:26:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f5902a00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 0x7f58e4067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58f4039000 tx=0x7f58f403c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7fe5d4200640 1 -- 172.21.15.146:0/3508331403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc13e360 msgr2=0x7fe5cc0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 --2- 172.21.15.146:0/3508331403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc13e360 0x7fe5cc0adb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0706f0 tx=0x7fe5c000a2b0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f667b200640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 0x7f66740d85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f667b200640 1 -- 172.21.15.146:0/3036994419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c04c200 con 0x7f66740d95c0 2024-08-17T02:26:10.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.102+0000 7f6679e00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 0x7f66740d85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7f667b200640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f667c02ae60 tx=0x7f667c0a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 -- 172.21.15.146:0/3508331403 shutdown_connections 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 --2- 172.21.15.146:0/3508331403 >> v2:172.21.15.150:3300/0 conn(0x7fe5cc13e730 0x7fe5cc069ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 --2- 172.21.15.146:0/3508331403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc13e360 0x7fe5cc0adb50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 -- 172.21.15.146:0/3508331403 >> 172.21.15.146:0/3508331403 conn(0x7fe5cc0cc480 msgr2=0x7fe5cc0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 -- 172.21.15.146:0/3508331403 shutdown_connections 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.103+0000 7fe5d4200640 1 -- 172.21.15.146:0/3508331403 wait complete. 2024-08-17T02:26:10.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780ada10 0x7f1578147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 0x7f1578159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578169440 con 0x7f15780ada10 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157815a9e0 con 0x7f15780cec60 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157f800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1578159d30 con 0x7f15780b3370 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f1577e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f1577e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33450/0 (socket says 172.21.15.146:33450) 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f1577e00640 1 -- 172.21.15.146:0/225133914 learned_addr learned my addr 172.21.15.146:0/225133914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.104+0000 7f157ce00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780ada10 0x7f1578147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f157d800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 0x7f1578159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1577e00640 1 -- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 msgr2=0x7f1578159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c06fdb0 con 0x7f66740d95c0 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0a6880 con 0x7f66740d95c0 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0a6c00 con 0x7f66740d95c0 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7fe5d4200640 1 Processor -- start 2024-08-17T02:26:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f59040c6f30 con 0x7f58fc0deea0 2024-08-17T02:26:10.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c001470 con 0x7f11740ac3d0 2024-08-17T02:26:10.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c02aa70 con 0x7f11740ac3d0 2024-08-17T02:26:10.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1172000640 1 -- 172.21.15.146:0/1910988366 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c001470 con 0x7f11740ac3d0 2024-08-17T02:26:10.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66740e1270 con 0x7f66740d95c0 2024-08-17T02:26:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66740d9b90 con 0x7f66740d95c0 2024-08-17T02:26:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1577e00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 0x7f1578159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1577e00640 1 -- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780ada10 msgr2=0x7f1578147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7fe5d4200640 1 -- start start 2024-08-17T02:26:10.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1577e00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780ada10 0x7f1578147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.105+0000 7f1577e00640 1 -- 172.21.15.146:0/225133914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009390 con 0x7f15780b3370 2024-08-17T02:26:10.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 -- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11740ac3d0 msgr2=0x7f11740ac850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11740ac3d0 0x7f11740ac850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f116c009850 tx=0x7f116c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f157d800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 0x7f1578159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1577e00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1564009850 tx=0x7f1564032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 -- 172.21.15.146:0/1910988366 shutdown_connections 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11740ac3d0 0x7f11740ac850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 --2- 172.21.15.146:0/1910988366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f117415d1c0 0x7f11740aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f1179600640 1 -- 172.21.15.146:0/1910988366 >> 172.21.15.146:0/1910988366 conn(0x7f1174096a70 msgr2=0x7f1174096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564031a60 con 0x7f15780b3370 2024-08-17T02:26:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564041030 con 0x7f15780b3370 2024-08-17T02:26:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564031e50 con 0x7f15780b3370 2024-08-17T02:26:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 0x7fe5cc154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 0x7fe5cc0a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0a6920 con 0x7fe5cc06a410 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc155e50 con 0x7fe5cc13e730 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d4200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc156130 con 0x7fe5cc13e360 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f3797e00640 1 -- 172.21.15.146:0/3034112173 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378402ad90 con 0x7f37980b0610 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f3797e00640 1 -- 172.21.15.146:0/3034112173 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784032440 con 0x7f37980b0610 2024-08-17T02:26:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.106+0000 7f3797e00640 1 -- 172.21.15.146:0/3034112173 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784032820 con 0x7f37980b0610 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d0e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d0e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33456/0 (socket says 172.21.15.146:33456) 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d0e00640 1 -- 172.21.15.146:0/232672722 learned_addr learned my addr 172.21.15.146:0/232672722 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7fe5d1800640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 0x7fe5cc154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7f1179600640 1 -- 172.21.15.146:0/1910988366 shutdown_connections 2024-08-17T02:26:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7f1179600640 1 -- 172.21.15.146:0/1910988366 wait complete. 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d2200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 0x7fe5cc0a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d1800640 1 -- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 msgr2=0x7fe5cc0a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d1800640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d1800640 1 -- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 msgr2=0x7fe5cc0a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d1800640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 0x7fe5cc0a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.108+0000 7fe5d1800640 1 -- 172.21.15.146:0/232672722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c000a530 con 0x7fe5cc06a410 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7fe5d0e00640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7fe5d2200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 0x7fe5cc0a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7f37a0400640 1 -- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 msgr2=0x7f379815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7f37a0400640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379815dc00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3784009880 tx=0x7f37840090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7fe5d1800640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 0x7fe5cc154740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0036000 tx=0x7fe5c003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157815a010 con 0x7f15780b3370 2024-08-17T02:26:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.107+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157815a670 con 0x7f15780b3370 2024-08-17T02:26:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f667c070050 con 0x7f66740d95c0 2024-08-17T02:26:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.109+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157815ab50 con 0x7f15780b3370 2024-08-17T02:26:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66740d9d80 con 0x7f66740d95c0 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 -- 172.21.15.146:0/3034112173 shutdown_connections 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 --2- 172.21.15.146:0/3034112173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379815dc00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 -- 172.21.15.146:0/3034112173 >> 172.21.15.146:0/3034112173 conn(0x7f37980cb9b0 msgr2=0x7f37980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000f470 con 0x7fe5cc06a410 2024-08-17T02:26:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000f5d0 con 0x7fe5cc06a410 2024-08-17T02:26:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000f970 con 0x7fe5cc06a410 2024-08-17T02:26:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc156410 con 0x7fe5cc06a410 2024-08-17T02:26:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 -- 172.21.15.146:0/3034112173 shutdown_connections 2024-08-17T02:26:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7fc8a3800640 1 Processor -- start 2024-08-17T02:26:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f1179600640 1 Processor -- start 2024-08-17T02:26:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f37a0400640 1 -- 172.21.15.146:0/3034112173 wait complete. 2024-08-17T02:26:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.111+0000 7f1179600640 1 -- start start 2024-08-17T02:26:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.111+0000 7fc8a3800640 1 -- start start 2024-08-17T02:26:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.111+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc154c80 con 0x7fe5cc06a410 2024-08-17T02:26:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.110+0000 7f6672000640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 0x7f665c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.111+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f667c119dc0 con 0x7f66740d95c0 2024-08-17T02:26:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.111+0000 7f667a800640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 0x7f665c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.112+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5cc064db0 con 0x7fe5cc06a410 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f37a0400640 1 Processor -- start 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a3800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0ada10 0x7fc89c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a3800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc89c0b38b0 0x7fc89c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a3800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0d0ab0 con 0x7fc89c0b1120 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a3800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c0b00c0 con 0x7fc89c0b38b0 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a3800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0af330 con 0x7fc89c0ada10 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f37a0400640 1 -- start start 2024-08-17T02:26:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11740ac3d0 0x7f1174099430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 0x7f117409b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a1800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc89c0b38b0 0x7fc89c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a1800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc89c0b38b0 0x7fc89c0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40376/0 (socket says 172.21.15.146:40376) 2024-08-17T02:26:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7fc8a1800640 1 -- 172.21.15.146:0/4144339549 learned_addr learned my addr 172.21.15.146:0/4144339549 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 0x7f117415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174098450 con 0x7f11740ac3d0 2024-08-17T02:26:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174098670 con 0x7f117415d1c0 2024-08-17T02:26:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.113+0000 7f1179600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1174098950 con 0x7f11740b0130 2024-08-17T02:26:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f116be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 0x7f117409b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f116be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 0x7f117409b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33484/0 (socket says 172.21.15.146:33484) 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f116be00640 1 -- 172.21.15.146:0/3727117030 learned_addr learned my addr 172.21.15.146:0/3727117030 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 0x7f117415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f667a800640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 0x7f665c067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f666c001660 tx=0x7f666c001a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379816d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 -- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 msgr2=0x7f117409b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 0x7f117409b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 -- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11740ac3d0 msgr2=0x7f1174099430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11740ac3d0 0x7f1174099430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f1173400640 1 -- 172.21.15.146:0/3727117030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009390 con 0x7f117415d1c0 2024-08-17T02:26:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f379815d830 0x7f379814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7fc8a0e00640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0ada10 0x7fc89c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379816d920 con 0x7f379815d830 2024-08-17T02:26:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f1173400640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 0x7f117415ad20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f117406a680 tx=0x7f116c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379816dc00 con 0x7f37980b0610 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f37a0400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379816dee0 con 0x7f379815e140 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33500/0 (socket says 172.21.15.146:33500) 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 -- 172.21.15.146:0/1120783446 learned_addr learned my addr 172.21.15.146:0/1120783446 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379d000640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f379815d830 0x7f379814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7fc8a1800640 1 -- 172.21.15.146:0/4144339549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0ada10 msgr2=0x7fc89c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7fc8a1800640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0ada10 0x7fc89c0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7fc8a1800640 1 -- 172.21.15.146:0/4144339549 >> v1:172.21.15.150:6789/0 conn(0x7fc89c0b1120 legacy=0x7fc89c0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7fc8a1800640 1 -- 172.21.15.146:0/4144339549 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0b0360 con 0x7fc89c0b38b0 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 -- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 msgr2=0x7f379816d2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379816d2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 -- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f379815d830 msgr2=0x7f379814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f379815d830 0x7f379814dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.115+0000 7f379e400640 1 -- 172.21.15.146:0/1120783446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009390 con 0x7f379815e140 2024-08-17T02:26:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.116+0000 7f379e400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f379000d890 tx=0x7f3790008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.116+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5c003d420 con 0x7fe5cc06a410 2024-08-17T02:26:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.114+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1564039040 con 0x7f15780b3370 2024-08-17T02:26:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.116+0000 7f156be00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 0x7f15580676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.117+0000 7fc8a1800640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b38b0 0x7fc89c0aedf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009910 tx=0x7fc88c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d092d62f6e116a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.117+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15640a36b0 con 0x7f15780b3370 2024-08-17T02:26:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.117+0000 7fe5c8c00640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 0x7fe5ac0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.117+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5c00a2ea0 con 0x7fe5cc06a410 2024-08-17T02:26:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.118+0000 7fe5d0e00640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 0x7fe5ac0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.119+0000 7fe5d0e00640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 0x7fe5ac0676d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc139f10 tx=0x7fe5b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.120+0000 7f157ce00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 0x7f15580676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.120+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c001470 con 0x7f117415d1c0 2024-08-17T02:26:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.121+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c032dd0 con 0x7f117415d1c0 2024-08-17T02:26:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.121+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c03d650 con 0x7f117415d1c0 2024-08-17T02:26:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.121+0000 7f157ce00640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 0x7f15580676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f156c007fd0 tx=0x7f156c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174098c30 con 0x7f117415d1c0 2024-08-17T02:26:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174161a00 con 0x7f117415d1c0 2024-08-17T02:26:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f667c0e7e60 con 0x7f66740d95c0 2024-08-17T02:26:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1564071990 con 0x7f15780b3370 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37900096a0 con 0x7f379815e140 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790009800 con 0x7f379815e140 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790009bc0 con 0x7f379815e140 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.122+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3798170990 con 0x7f379815e140 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.123+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379814e260 con 0x7f379815e140 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.123+0000 7fc89b400640 1 -- 172.21.15.146:0/4144339549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c032440 con 0x7fc89c0b38b0 2024-08-17T02:26:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.123+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174161bf0 con 0x7f117415d1c0 2024-08-17T02:26:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5c0071190 con 0x7fe5cc06a410 2024-08-17T02:26:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7fc89b400640 1 -- 172.21.15.146:0/4144339549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c0325a0 con 0x7fc89c0b38b0 2024-08-17T02:26:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7fc89b400640 1 -- 172.21.15.146:0/4144339549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c032960 con 0x7fc89c0b38b0 2024-08-17T02:26:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3798064db0 con 0x7f379815e140 2024-08-17T02:26:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7fc8a3800640 1 -- 172.21.15.146:0/4144339549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b38b0 msgr2=0x7fc89c0aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.124+0000 7fc8a3800640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b38b0 0x7fc89c0aedf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009910 tx=0x7fc88c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.125+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f116c03da40 con 0x7f117415d1c0 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.125+0000 7fc8a3800640 1 -- 172.21.15.146:0/4144339549 shutdown_connections 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.125+0000 7fc8a3800640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b38b0 0x7fc89c0aedf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.125+0000 7fc8a3800640 1 --2- 172.21.15.146:0/4144339549 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0ada10 0x7fc89c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.125+0000 7fc8a3800640 1 -- 172.21.15.146:0/4144339549 >> 172.21.15.146:0/4144339549 conn(0x7fc89c0cfdf0 msgr2=0x7fc89c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.126+0000 7fc8a3800640 1 -- 172.21.15.146:0/4144339549 shutdown_connections 2024-08-17T02:26:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.126+0000 7f116a000640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 0x7f1150067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.126+0000 7fc8a3800640 1 -- 172.21.15.146:0/4144339549 wait complete. 2024-08-17T02:26:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.127+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f116c0a2dc0 con 0x7f117415d1c0 2024-08-17T02:26:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.127+0000 7f1172a00640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 0x7f1150067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.126+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3790014410 con 0x7f379815e140 2024-08-17T02:26:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.127+0000 7f3794c00640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 0x7f3778067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.128+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3790082c20 con 0x7f379815e140 2024-08-17T02:26:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.128+0000 7f1172a00640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 0x7f1150067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11640094d0 tx=0x7f11640096b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.129+0000 7f379da00640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 0x7f3778067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.128+0000 7fc8a3800640 1 Processor -- start 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.129+0000 7fc8a3800640 1 -- start start 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 0x7fc89c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0b38b0 0x7fc89c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c16ccf0 con 0x7fc89c0b1120 2024-08-17T02:26:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c15a790 con 0x7fc89c0ada10 2024-08-17T02:26:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7f379da00640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 0x7f3778067750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f378c005bc0 tx=0x7f378c0015e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a3800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c16d560 con 0x7fc89c0b38b0 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a0e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:40016/0 (socket says 172.21.15.146:40016) 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a0e00640 1 -- 172.21.15.146:0/253571742 learned_addr learned my addr 172.21.15.146:0/253571742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc8a1800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0b38b0 0x7fc89c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.130+0000 7fc89be00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 0x7fc89c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 -- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0b38b0 msgr2=0x7fc89c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0b38b0 0x7fc89c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 -- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 msgr2=0x7fc89c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 0x7fc89c152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 -- 172.21.15.146:0/253571742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009450 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc89be00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 0x7fc89c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.131+0000 7fc8a0e00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc88800ea80 tx=0x7fc8880090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.133+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800ca10 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.133+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800cb70 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.133+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888013470 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.133+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c15a210 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.134+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c16cf10 con 0x7fc89c0ada10 2024-08-17T02:26:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.134+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f116c070e60 con 0x7f117415d1c0 2024-08-17T02:26:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.135+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3790050cc0 con 0x7f379815e140 2024-08-17T02:26:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.135+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c064db0 con 0x7fc89c0ada10 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.137+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc888013860 con 0x7fc89c0ada10 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.139+0000 7fc893e00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 0x7fc87c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.139+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8880826b0 con 0x7fc89c0ada10 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.140+0000 7fc89be00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 0x7fc87c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.141+0000 7fc89be00640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 0x7fc87c067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc89c158710 tx=0x7fc894009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.143+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc888050820 con 0x7fc89c0ada10 2024-08-17T02:26:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.506+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f58fc007550 con 0x7f58fc0deea0 2024-08-17T02:26:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.507+0000 7f58fa000640 1 -- 172.21.15.146:0/377400369 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5904095020 con 0x7f58fc0deea0 2024-08-17T02:26:10.511 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-08-17T02:26:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 msgr2=0x7f58e4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 0x7f58e4067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58f4039000 tx=0x7f58f403c000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 msgr2=0x7f58fc0d7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f590404c0c0 tx=0x7f590406f710 comp rx=0 tx=0).stop 2024-08-17T02:26:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 shutdown_connections 2024-08-17T02:26:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f58e40652a0 0x7f58e4067750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0deea0 0x7f58fc0d7f40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58fc0dead0 0x7f58fc0d7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 --2- 172.21.15.146:0/377400369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58fc050fb0 0x7f58fc0f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.511+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 >> 172.21.15.146:0/377400369 conn(0x7f58fc055ca0 msgr2=0x7f58fc035a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.512+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 shutdown_connections 2024-08-17T02:26:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.512+0000 7f5903e00640 1 -- 172.21.15.146:0/377400369 wait complete. 2024-08-17T02:26:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.513+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff31413e700 con 0x7ff31406dc80 2024-08-17T02:26:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.514+0000 7ff30aa00640 1 -- 172.21.15.146:0/3577347996 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff304052fb0 con 0x7ff31406dc80 2024-08-17T02:26:10.517 INFO:teuthology.orchestra.run.smithi146.stdout:55834574852 2024-08-17T02:26:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.517+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 msgr2=0x7ff2f4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.517+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 0x7ff2f4067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff300034000 tx=0x7ff300035000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.517+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 msgr2=0x7ff31413a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.517+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c590 tx=0x7ff304007ee0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 shutdown_connections 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff2f40652a0 0x7ff2f4067750 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff300034000 tx=0x7ff300035000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3140cae00 0x7ff31415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3140cb1d0 0x7ff314159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 --2- 172.21.15.146:0/3577347996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31406dc80 0x7ff31413a8e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.518+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 >> 172.21.15.146:0/3577347996 conn(0x7ff314067750 msgr2=0x7ff3140aa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.520+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 shutdown_connections 2024-08-17T02:26:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.520+0000 7ff31a000640 1 -- 172.21.15.146:0/3577347996 wait complete. 2024-08-17T02:26:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.532+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1578064db0 con 0x7f15780b3370 2024-08-17T02:26:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.533+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66740d9d80 con 0x7f66740d95c0 2024-08-17T02:26:10.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.534+0000 7f156be00640 1 -- 172.21.15.146:0/225133914 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1564037090 con 0x7f15780b3370 2024-08-17T02:26:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.536+0000 7f6672000640 1 -- 172.21.15.146:0/3036994419 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f667c0eb480 con 0x7f66740d95c0 2024-08-17T02:26:10.538 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:10.538 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:10.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 msgr2=0x7f15580676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 0x7f15580676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f156c007fd0 tx=0x7f156c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 msgr2=0x7f1578168f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1564009850 tx=0x7f1564032000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 shutdown_connections 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1558065220 0x7f15580676d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15780cec60 0x7f1578159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15780b3370 0x7f1578168f00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 --2- 172.21.15.146:0/225133914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15780ada10 0x7f1578147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 >> 172.21.15.146:0/225133914 conn(0x7f15780cfdf0 msgr2=0x7f15780adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.538+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 shutdown_connections 2024-08-17T02:26:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.539+0000 7f157f800640 1 -- 172.21.15.146:0/225133914 wait complete. 2024-08-17T02:26:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.539+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe5cc06ad20 con 0x7fe5cc06a410 2024-08-17T02:26:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.540+0000 7fe5c8c00640 1 -- 172.21.15.146:0/232672722 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5c0074770 con 0x7fe5cc06a410 2024-08-17T02:26:10.542 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.540+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 msgr2=0x7f665c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.540+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 0x7f665c067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f666c001660 tx=0x7f666c001a50 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.540+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 msgr2=0x7f6674038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.540+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f667c02ae60 tx=0x7f667c0a9000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 shutdown_connections 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f665c0652a0 0x7f665c067750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66740d91f0 0x7f66740d85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66740d95c0 0x7f6674038270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 --2- 172.21.15.146:0/3036994419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6674034480 0x7f66740dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 >> 172.21.15.146:0/3036994419 conn(0x7f6674009fa0 msgr2=0x7f66740509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 shutdown_connections 2024-08-17T02:26:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.541+0000 7f6680a00640 1 -- 172.21.15.146:0/3036994419 wait complete. 2024-08-17T02:26:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 msgr2=0x7fe5ac0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 0x7fe5ac0676d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc139f10 tx=0x7fe5b8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 msgr2=0x7fe5cc154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 0x7fe5cc154740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0036000 tx=0x7fe5c003c000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-08-17T02:26:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 shutdown_connections 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe5ac065220 0x7fe5ac0676d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5cc13e730 0x7fe5cc0a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5cc13e360 0x7fe5cc0a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 --2- 172.21.15.146:0/232672722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5cc06a410 0x7fe5cc154740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.544+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 >> 172.21.15.146:0/232672722 conn(0x7fe5cc0cc480 msgr2=0x7fe5cc13c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.545+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 shutdown_connections 2024-08-17T02:26:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.545+0000 7fe5d4200640 1 -- 172.21.15.146:0/232672722 wait complete. 2024-08-17T02:26:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.546+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f379816e020 con 0x7f379815e140 2024-08-17T02:26:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.546+0000 7f3794c00640 1 -- 172.21.15.146:0/1120783446 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f379816e020 con 0x7f379815e140 2024-08-17T02:26:10.550 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 msgr2=0x7f3778067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 0x7f3778067750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f378c005bc0 tx=0x7f378c0015e0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 msgr2=0x7f3798159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f379000d890 tx=0x7f3790008040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 shutdown_connections 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f37780652a0 0x7f3778067750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f379815d830 0x7f379814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f379815e140 0x7f3798159430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 --2- 172.21.15.146:0/1120783446 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37980b0610 0x7f379816d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 >> 172.21.15.146:0/1120783446 conn(0x7f37980cb9b0 msgr2=0x7f379806a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 shutdown_connections 2024-08-17T02:26:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.551+0000 7f37a0400640 1 -- 172.21.15.146:0/1120783446 wait complete. 2024-08-17T02:26:10.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.555+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f11740987b0 con 0x7f117415d1c0 2024-08-17T02:26:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.556+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc89c0afb60 con 0x7fc89c0ada10 2024-08-17T02:26:10.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.556+0000 7f116a000640 1 -- 172.21.15.146:0/3727117030 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11740987b0 con 0x7f117415d1c0 2024-08-17T02:26:10.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.556+0000 7fc893e00640 1 -- 172.21.15.146:0/253571742 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc888053e40 con 0x7fc89c0ada10 2024-08-17T02:26:10.558 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:10.558 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:10.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 msgr2=0x7fc87c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 0x7fc87c067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc89c158710 tx=0x7fc894009040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 msgr2=0x7fc89c0cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc88800ea80 tx=0x7fc8880090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 shutdown_connections 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc87c065150 0x7fc87c067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b1120 0x7fc89c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc89c0b38b0 0x7fc89c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 --2- 172.21.15.146:0/253571742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc89c0ada10 0x7fc89c0cf140 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.560+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 >> 172.21.15.146:0/253571742 conn(0x7fc89c0cfdf0 msgr2=0x7fc89c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 shutdown_connections 2024-08-17T02:26:10.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7fc8a3800640 1 -- 172.21.15.146:0/253571742 wait complete. 2024-08-17T02:26:10.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 msgr2=0x7f1150067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 0x7f1150067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11640094d0 tx=0x7f11640096b0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 msgr2=0x7f117415ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 0x7f117415ad20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f117406a680 tx=0x7f116c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 shutdown_connections 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11500652a0 0x7f1150067750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f117415d1c0 0x7f117415ad20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11740b0130 0x7f117409b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 --2- 172.21.15.146:0/3727117030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11740ac3d0 0x7f1174099430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 >> 172.21.15.146:0/3727117030 conn(0x7f1174096a70 msgr2=0x7f1174096e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 shutdown_connections 2024-08-17T02:26:10.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:10.561+0000 7f1179600640 1 -- 172.21.15.146:0/3727117030 wait complete. 2024-08-17T02:26:10.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-17T02:26:10.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-08-17T02:26:10.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-08-17T02:26:10.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-08-17T02:26:10.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-08-17T02:26:10.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-08-17T02:26:11.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:26:11.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:26:11.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:26:11.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:26:11.573 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:26:11.573 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:26:11.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:26:11.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:26:11.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.771+0000 7f4c2a400640 1 Processor -- start 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.772+0000 7f4c2a400640 1 -- start start 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.774+0000 7f4c2a400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4c2415cba0 0x7f4c2415cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.774+0000 7f4c2a400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 0x7f4c2415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.774+0000 7f4c2a400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240ce480 con 0x7f4c2415c200 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.774+0000 7f4c2a400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240d0380 con 0x7f4c2415d4b0 2024-08-17T02:26:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.774+0000 7f4c2a400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240d0660 con 0x7f4c2415cba0 2024-08-17T02:26:11.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.775+0000 7f4c23e00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4c2415c200 0x7f4c240ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48354/0 (socket says 172.21.15.146:48354) 2024-08-17T02:26:11.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.775+0000 7f4c23e00640 1 -- 172.21.15.146:0/4288957079 learned_addr learned my addr 172.21.15.146:0/4288957079 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.775+0000 7f4c23400640 1 --2- 172.21.15.146:0/4288957079 >> v2:172.21.15.150:3300/0 conn(0x7f4c2415cba0 0x7f4c2415cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.776+0000 7f4c22a00640 1 --2- 172.21.15.146:0/4288957079 >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 0x7f4c2415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.776+0000 7f4c23400640 1 -- 172.21.15.146:0/4288957079 >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 msgr2=0x7f4c2415bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.777+0000 7f4c22000640 1 -- 172.21.15.146:0/4288957079 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659358782 0 0) 0x7f4c240ce480 con 0x7f4c2415c200 2024-08-17T02:26:11.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.777+0000 7f4c23400640 1 --2- 172.21.15.146:0/4288957079 >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 0x7f4c2415bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.777+0000 7f4c23400640 1 -- 172.21.15.146:0/4288957079 >> v1:172.21.15.150:6789/0 conn(0x7f4c2415c200 legacy=0x7f4c240ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.777+0000 7f4c23400640 1 -- 172.21.15.146:0/4288957079 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240d0940 con 0x7f4c2415cba0 2024-08-17T02:26:11.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.778+0000 7f4c22a00640 1 --2- 172.21.15.146:0/4288957079 >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 0x7f4c2415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:11.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.779+0000 7f4c23400640 1 --2- 172.21.15.146:0/4288957079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415cba0 0x7f4c2415cf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c24069970 tx=0x7f4c100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d39f80514ac8359f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.780+0000 7f4c22000640 1 -- 172.21.15.146:0/4288957079 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1002ae80 con 0x7f4c2415cba0 2024-08-17T02:26:11.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.780+0000 7f4c22000640 1 -- 172.21.15.146:0/4288957079 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10032440 con 0x7f4c2415cba0 2024-08-17T02:26:11.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.780+0000 7f4c22000640 1 -- 172.21.15.146:0/4288957079 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100327c0 con 0x7f4c2415cba0 2024-08-17T02:26:11.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.781+0000 7f4c2a400640 1 -- 172.21.15.146:0/4288957079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415cba0 msgr2=0x7f4c2415cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.782+0000 7f4c2a400640 1 --2- 172.21.15.146:0/4288957079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415cba0 0x7f4c2415cf70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4c24069970 tx=0x7f4c100090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.782+0000 7f4c2a400640 1 -- 172.21.15.146:0/4288957079 shutdown_connections 2024-08-17T02:26:11.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.782+0000 7f4c2a400640 1 --2- 172.21.15.146:0/4288957079 >> v2:172.21.15.146:3300/0 conn(0x7f4c2415d4b0 0x7f4c2415bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.782+0000 7f4c2a400640 1 --2- 172.21.15.146:0/4288957079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415cba0 0x7f4c2415cf70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.782+0000 7f4c2a400640 1 -- 172.21.15.146:0/4288957079 >> 172.21.15.146:0/4288957079 conn(0x7f4c2406eb90 msgr2=0x7f4c240cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.783+0000 7f4c2a400640 1 -- 172.21.15.146:0/4288957079 shutdown_connections 2024-08-17T02:26:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.783+0000 7f4c2a400640 1 -- 172.21.15.146:0/4288957079 wait complete. 2024-08-17T02:26:11.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.786+0000 7f4c2a400640 1 Processor -- start 2024-08-17T02:26:11.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.787+0000 7f4c2a400640 1 -- start start 2024-08-17T02:26:11.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.789+0000 7f4c2a400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c2415c200 0x7f4c240c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.789+0000 7f4c2a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c2415cba0 0x7f4c240af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c2a400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c2a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240b0870 con 0x7f4c2415cba0 2024-08-17T02:26:11.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c2a400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240af9e0 con 0x7f4c2415d4b0 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c2a400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240afc60 con 0x7f4c2415c200 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c23400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c2415c200 0x7f4c240c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c23e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c23e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:40026/0 (socket says 172.21.15.146:40026) 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.790+0000 7f4c23e00640 1 -- 172.21.15.146:0/1006694000 learned_addr learned my addr 172.21.15.146:0/1006694000 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 -- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c2415c200 msgr2=0x7f4c240c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c2415c200 0x7f4c240c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 -- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c2415cba0 msgr2=0x7f4c240af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c2415cba0 0x7f4c240af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 -- 172.21.15.146:0/1006694000 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10009390 con 0x7f4c2415d4b0 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.791+0000 7f4c23e00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00cc90 tx=0x7f4c1c001ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.792+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00aad0 con 0x7f4c2415d4b0 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.792+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00ac30 con 0x7f4c2415d4b0 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.792+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00aad0 con 0x7f4c2415d4b0 2024-08-17T02:26:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.792+0000 7f4c2a400640 1 -- 172.21.15.146:0/1006694000 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c240aff40 con 0x7f4c2415d4b0 2024-08-17T02:26:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.793+0000 7f4c2a400640 1 -- 172.21.15.146:0/1006694000 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c240b0500 con 0x7f4c2415d4b0 2024-08-17T02:26:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.794+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8005210 con 0x7f4c2415d4b0 2024-08-17T02:26:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.797+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4c1c007300 con 0x7f4c2415d4b0 2024-08-17T02:26:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.798+0000 7f4c16a00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 0x7f4c04067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.802+0000 7f4c23400640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 0x7f4c04067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.803+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c1c054180 con 0x7f4c2415d4b0 2024-08-17T02:26:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.805+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4c1c087060 con 0x7f4c2415d4b0 2024-08-17T02:26:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.805+0000 7f4c23400640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 0x7f4c04067660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c10034000 tx=0x7f4c10032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.854+0000 7ff9d5e00640 1 Processor -- start 2024-08-17T02:26:11.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.854+0000 7ff9d5e00640 1 -- start start 2024-08-17T02:26:11.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 0x7ff9d0069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.854+0000 7f92dd000640 1 Processor -- start 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.854+0000 7f92dd000640 1 -- start start 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.856+0000 7f92dd000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92d8160d60 0x7f92d81611d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7f92dd000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d8161710 con 0x7f92d8069b10 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7f92dd000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d8069680 con 0x7f92d8157730 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7f92dd000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d80b0cc0 con 0x7f92d8160d60 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7f92d6800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f92d8069b10 0x7f92d8069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55924/0 (socket says 172.21.15.146:55924) 2024-08-17T02:26:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.857+0000 7f92d6800640 1 -- 172.21.15.146:0/2601689397 learned_addr learned my addr 172.21.15.146:0/2601689397 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7ff9d5e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d006ab20 con 0x7ff9d013b4e0 2024-08-17T02:26:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7ff9d5e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d0069f10 con 0x7ff9d0069a90 2024-08-17T02:26:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7ff9d5e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d006afb0 con 0x7ff9d013b110 2024-08-17T02:26:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204976903 0 0) 0x7f92d8161710 con 0x7f92d8069b10 2024-08-17T02:26:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc0034e0 con 0x7f92d8069b10 2024-08-17T02:26:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7ff9cf400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff9d013b4e0 0x7ff9d00ac120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55936/0 (socket says 172.21.15.146:55936) 2024-08-17T02:26:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.858+0000 7ff9cf400640 1 -- 172.21.15.146:0/930623169 learned_addr learned my addr 172.21.15.146:0/930623169 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7ff9cea00640 1 --2- 172.21.15.146:0/930623169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 0x7ff9d0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658010771 0 0) 0x7f92bc0034e0 con 0x7f92d8069b10 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 >> v2:172.21.15.150:3300/0 conn(0x7f92d8160d60 msgr2=0x7f92d81611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d5400640 1 --2- 172.21.15.146:0/2601689397 >> v2:172.21.15.150:3300/0 conn(0x7f92d8160d60 0x7f92d81611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 --2- 172.21.15.146:0/2601689397 >> v2:172.21.15.150:3300/0 conn(0x7f92d8160d60 0x7f92d81611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 >> v1:172.21.15.150:6789/0 conn(0x7f92d8157730 legacy=0x7f92d80ae6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80aedc0 con 0x7f92d8069b10 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f92d00017f0 con 0x7f92d8069b10 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 >> v1:172.21.15.146:6789/0 conn(0x7f92d8069b10 legacy=0x7f92d8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc003aa0 0x7f92bc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92bc004780 0x7f92bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 0x7f92bc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b0cc0 con 0x7f92bc005380 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c270 con 0x7f92bc003aa0 2024-08-17T02:26:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.859+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00c430 con 0x7f92bc004780 2024-08-17T02:26:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.860+0000 7ff9cea00640 1 -- 172.21.15.146:0/930623169 >> v1:172.21.15.150:6789/0 conn(0x7ff9d0069a90 legacy=0x7ff9d00ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.860+0000 7ff9cea00640 1 -- 172.21.15.146:0/930623169 >> v1:172.21.15.146:6789/0 conn(0x7ff9d013b4e0 legacy=0x7ff9d00ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.860+0000 7ff9cea00640 1 -- 172.21.15.146:0/930623169 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d006a1f0 con 0x7ff9d013b110 2024-08-17T02:26:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7ff9cea00640 1 --2- 172.21.15.146:0/930623169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 0x7ff9d0069550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009880 tx=0x7ff9bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=305639c9187f43fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7ff9cd600640 1 -- 172.21.15.146:0/930623169 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc02abf0 con 0x7ff9d013b110 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.861+0000 7f92d6800640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 0x7f92bc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.861+0000 7f92d5e00640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc003aa0 0x7f92bc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d5400640 1 --2- 172.21.15.146:0/2601689397 >> v2:172.21.15.150:3300/0 conn(0x7f92d8160d60 0x7f92d81611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d6800640 1 -- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92bc004780 msgr2=0x7f92bc004bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d6800640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92bc004780 0x7f92bc004bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d6800640 1 -- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc003aa0 msgr2=0x7f92bc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d6800640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc003aa0 0x7f92bc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7f92d6800640 1 -- 172.21.15.146:0/2601689397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0034e0 con 0x7f92bc005380 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.862+0000 7ff9cd600640 1 -- 172.21.15.146:0/930623169 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc02ad50 con 0x7ff9d013b110 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.863+0000 7ff9cd600640 1 -- 172.21.15.146:0/930623169 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc032670 con 0x7ff9d013b110 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.863+0000 7ff9d5e00640 1 -- 172.21.15.146:0/930623169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 msgr2=0x7ff9d0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.863+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/930623169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 0x7ff9d0069550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009880 tx=0x7ff9bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7f92d6800640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 0x7f92bc00ba30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92d000a890 tx=0x7f92d80695f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688def235a67bc9b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7f92d6800640 1 -- 172.21.15.146:0/2601689397 reap_dead start 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7ff9d5e00640 1 -- 172.21.15.146:0/930623169 shutdown_connections 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/930623169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b110 0x7ff9d0069550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7ff9d5e00640 1 -- 172.21.15.146:0/930623169 >> 172.21.15.146:0/930623169 conn(0x7ff9d00cb7a0 msgr2=0x7ff9d00cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7ff9d5e00640 1 -- 172.21.15.146:0/930623169 shutdown_connections 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.865+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00070f0 con 0x7f92bc005380 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.865+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0007290 con 0x7f92bc005380 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.865+0000 7f92d4a00640 1 -- 172.21.15.146:0/2601689397 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007650 con 0x7f92bc005380 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7f92dd000640 1 -- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 msgr2=0x7f92bc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7f92dd000640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 0x7f92bc00ba30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f92d000a890 tx=0x7f92d80695f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.864+0000 7ff9d5e00640 1 -- 172.21.15.146:0/930623169 wait complete. 2024-08-17T02:26:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7ff9d5e00640 1 Processor -- start 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7f92dd000640 1 -- 172.21.15.146:0/2601689397 shutdown_connections 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7f92dd000640 1 --2- 172.21.15.146:0/2601689397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc005380 0x7f92bc00ba30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.866+0000 7f92dd000640 1 -- 172.21.15.146:0/2601689397 >> 172.21.15.146:0/2601689397 conn(0x7f92d80cb7a0 msgr2=0x7f92d80cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.867+0000 7f92dd000640 1 -- 172.21.15.146:0/2601689397 shutdown_connections 2024-08-17T02:26:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.867+0000 7f92dd000640 1 -- 172.21.15.146:0/2601689397 wait complete. 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.867+0000 7ff9d5e00640 1 -- start start 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 0x7ff9d014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 0x7ff9d015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7f92dd000640 1 Processor -- start 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7f92dd000640 1 -- start start 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7f3cb3200640 1 Processor -- start 2024-08-17T02:26:11.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7ff9cea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 0x7ff9d014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7ff9cea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 0x7ff9d014fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40426/0 (socket says 172.21.15.146:40426) 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7ff9ce000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 0x7ff9d015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7ff9ce000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 0x7ff9d015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33538/0 (socket says 172.21.15.146:33538) 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7ff9d5e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 0x7ff9d0151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7ff9ce000640 1 -- 172.21.15.146:0/2923040835 learned_addr learned my addr 172.21.15.146:0/2923040835 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.869+0000 7f3cb3200640 1 -- start start 2024-08-17T02:26:11.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01520c0 con 0x7ff9d013b110 2024-08-17T02:26:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7fa84ea00640 1 Processor -- start 2024-08-17T02:26:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7ff9cf400640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 0x7ff9d0151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.870+0000 7f92dd000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc005380 0x7f92d8140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0150050 con 0x7ff9d0151700 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d01777b0 con 0x7ff9d013b4e0 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f92dd000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 0x7f92d8137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f92dd000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 0x7f92d813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f92dd000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d813dd70 con 0x7f92d81444c0 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f92dd000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d813c8a0 con 0x7f92bc005380 2024-08-17T02:26:11.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f92dd000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8140ca0 con 0x7f92d81382f0 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3cb3200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cb4158c80 0x7f3cb40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3cb3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 0x7f3cb40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3cb3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40cf9d0 con 0x7f3cb40cc800 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3cb3200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40ceb60 con 0x7f3cb4158c80 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3cb3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40cedc0 con 0x7f3cb40cd700 2024-08-17T02:26:11.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7f3ae5600640 1 Processor -- start 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f3cb1400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 0x7f3cb40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f3cb1400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 0x7f3cb40cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33548/0 (socket says 172.21.15.146:33548) 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f3cb1400640 1 -- 172.21.15.146:0/1796920354 learned_addr learned my addr 172.21.15.146:0/1796920354 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7ff9cf400640 1 -- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 msgr2=0x7ff9d015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7ff9cf400640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 0x7ff9d015aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7ff9cf400640 1 -- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 msgr2=0x7ff9d014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/1796920354 >> v2:172.21.15.150:3300/0 conn(0x7f3cb4158c80 0x7f3cb40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f92d5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 0x7f92d8137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f92d5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 0x7f92d8137db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40442/0 (socket says 172.21.15.146:40442) 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f92d5400640 1 -- 172.21.15.146:0/3779416979 learned_addr learned my addr 172.21.15.146:0/3779416979 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f92d6800640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 0x7f92d813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.871+0000 7fa84ea00640 1 -- start start 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ea00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8480b3370 0x7fa8480b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ea00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480d0ab0 con 0x7fa8480ada10 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ea00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480b00c0 con 0x7fa8480b3370 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ea00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480af330 con 0x7fa8480b1120 2024-08-17T02:26:11.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f92d5e00640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc005380 0x7f92d8140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7ff9cf400640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 0x7ff9d014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7ff9cf400640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009390 con 0x7ff9d0151700 2024-08-17T02:26:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa847e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa8480ada10 0x7fa8480b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55952/0 (socket says 172.21.15.146:55952) 2024-08-17T02:26:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa847e00640 1 -- 172.21.15.146:0/3342690521 learned_addr learned my addr 172.21.15.146:0/3342690521 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f3cb1e00640 1 -- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 msgr2=0x7f3cb40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 0x7f3cb40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f3cb1e00640 1 -- 172.21.15.146:0/1796920354 >> v1:172.21.15.146:6789/0 conn(0x7f3cb40cc800 legacy=0x7f3cb40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7f3cb1e00640 1 -- 172.21.15.146:0/1796920354 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40cf0a0 con 0x7f3cb4158c80 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 -- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc005380 msgr2=0x7f92d8140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc005380 0x7f92d8140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 -- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 msgr2=0x7f92d8137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 0x7f92d8137db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 -- 172.21.15.146:0/3779416979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d813a070 con 0x7f92d81382f0 2024-08-17T02:26:11.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.873+0000 7fa84ca00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8480b3370 0x7fa8480b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92d6800640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 0x7f92d813cd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92d8070900 tx=0x7f92d0034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f2aa8000640 1 Processor -- start 2024-08-17T02:26:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa847400640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa84ca00640 1 -- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 msgr2=0x7fa8480aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.872+0000 7f3ae5600640 1 -- start start 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f3ae5600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae00b3370 0x7f3ae00b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f3ae5600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00d0ab0 con 0x7f3ae00b1120 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f3ae5600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b00c0 con 0x7f3ae00ada10 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f3ae5600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00b0360 con 0x7f3ae00b3370 2024-08-17T02:26:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00016f0 con 0x7f92d81382f0 2024-08-17T02:26:11.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00079c0 con 0x7f92d81382f0 2024-08-17T02:26:11.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007400 con 0x7f92d81382f0 2024-08-17T02:26:11.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d813dfc0 con 0x7f92d81382f0 2024-08-17T02:26:11.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.875+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d813a650 con 0x7f92d81382f0 2024-08-17T02:26:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.875+0000 7f3ade000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ae00b1120 0x7f3ae00aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55962/0 (socket says 172.21.15.146:55962) 2024-08-17T02:26:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.875+0000 7f3adea00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3ae00ada10 0x7f3ae00b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:48374/0 (socket says 172.21.15.146:48374) 2024-08-17T02:26:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.875+0000 7f3adea00640 1 -- 172.21.15.146:0/1647611268 learned_addr learned my addr 172.21.15.146:0/1647611268 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.875+0000 7f3adf400640 1 --2- 172.21.15.146:0/1647611268 >> v2:172.21.15.146:3300/0 conn(0x7f3ae00b3370 0x7f3ae00b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7f2aa8000640 1 -- start start 2024-08-17T02:26:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7ff9cf400640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 0x7ff9d0151b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8002230 tx=0x7ff9c8001a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301979874 0 0) 0x7f3ae00b00c0 con 0x7f3ae00ada10 2024-08-17T02:26:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800ce80 con 0x7ff9d0151700 2024-08-17T02:26:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac40034e0 con 0x7f3ae00ada10 2024-08-17T02:26:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606071062 0 0) 0x7f3ae00d0ab0 con 0x7f3ae00b1120 2024-08-17T02:26:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f2aa8000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2aa006a5e0 0x7f2aa013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f2aa8000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2aa006e7f0 0x7f2aa00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f2aa8000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00af6e0 con 0x7f2aa013e2d0 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f2aa8000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00acb40 con 0x7f2aa006a5e0 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f2aa8000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00ad6c0 con 0x7f2aa006e7f0 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa84ca00640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa84ca00640 1 -- 172.21.15.146:0/3342690521 >> v1:172.21.15.146:6789/0 conn(0x7fa8480ada10 legacy=0x7fa8480b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa84ca00640 1 -- 172.21.15.146:0/3342690521 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480b0360 con 0x7fa8480b3370 2024-08-17T02:26:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.874+0000 7fa847400640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f8b53200640 1 Processor -- start 2024-08-17T02:26:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae00b00c0 con 0x7f3ae00b1120 2024-08-17T02:26:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c800a850 con 0x7ff9d0151700 2024-08-17T02:26:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800ac50 con 0x7ff9d0151700 2024-08-17T02:26:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0176ba0 con 0x7ff9d0151700 2024-08-17T02:26:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa5600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2aa013e2d0 0x7f2aa0069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55968/0 (socket says 172.21.15.146:55968) 2024-08-17T02:26:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa5600640 1 -- 172.21.15.146:0/3166430140 learned_addr learned my addr 172.21.15.146:0/3166430140 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 898407438 0 0) 0x7f3ac40034e0 con 0x7f3ae00ada10 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.876+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 >> v2:172.21.15.146:3300/0 conn(0x7f3ae00b3370 msgr2=0x7f3ae00b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 --2- 172.21.15.146:0/1647611268 >> v2:172.21.15.146:3300/0 conn(0x7f3ae00b3370 0x7f3ae00b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 >> v1:172.21.15.146:6789/0 conn(0x7f3ae00b1120 legacy=0x7f3ae00aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00b0640 con 0x7f3ae00ada10 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa6000640 1 --2- 172.21.15.146:0/3166430140 >> v2:172.21.15.150:3300/0 conn(0x7f2aa006e7f0 0x7f2aa00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa4c00640 1 --2- 172.21.15.146:0/3166430140 >> v2:172.21.15.146:3300/0 conn(0x7f2aa006a5e0 0x7f2aa013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa6000640 1 -- 172.21.15.146:0/3166430140 >> v2:172.21.15.146:3300/0 conn(0x7f2aa006a5e0 msgr2=0x7f2aa013e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa6000640 1 --2- 172.21.15.146:0/3166430140 >> v2:172.21.15.146:3300/0 conn(0x7f2aa006a5e0 0x7f2aa013e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa6000640 1 -- 172.21.15.146:0/3166430140 >> v1:172.21.15.146:6789/0 conn(0x7f2aa013e2d0 legacy=0x7f2aa0069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f2aa6000640 1 -- 172.21.15.146:0/3166430140 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00acd90 con 0x7f2aa006e7f0 2024-08-17T02:26:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92d0037660 con 0x7f92d81382f0 2024-08-17T02:26:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f8b53200640 1 -- start start 2024-08-17T02:26:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0005210 con 0x7f92d81382f0 2024-08-17T02:26:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7fa84ca00640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480b3370 0x7fa8480b37f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e60 tx=0x7fa838009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6bd565c3625726 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4158c80 0x7f3cb40ce620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009850 tx=0x7f3ca00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37f3ee89ffc81ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f3ad0001470 con 0x7f3ae00ada10 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 >> v1:172.21.15.150:6789/0 conn(0x7f3ae00ada10 legacy=0x7f3ae00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ac4004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ac4004780 0x7f3ac4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ac40051f0 0x7f3ac400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00b0360 con 0x7f3ac40051f0 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4014910 con 0x7f3ac4003c30 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4014ad0 con 0x7f3ac4004780 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7f3adf400640 1 --2- 172.21.15.146:0/1647611268 >> v2:172.21.15.146:3300/0 conn(0x7f3ae00b3370 0x7f3ae00b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f3adf400640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ac40051f0 0x7f3ac400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f3ade000640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ac4004780 0x7f3ac4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f3cb0a00640 1 -- 172.21.15.146:0/1796920354 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca002ab40 con 0x7f3cb4158c80 2024-08-17T02:26:11.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.878+0000 7f3adea00640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ac4004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7fa846a00640 1 -- 172.21.15.146:0/3342690521 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838007550 con 0x7fa8480b3370 2024-08-17T02:26:11.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3cb0a00640 1 -- 172.21.15.146:0/1796920354 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca002aca0 con 0x7f3cb4158c80 2024-08-17T02:26:11.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3cb0a00640 1 -- 172.21.15.146:0/1796920354 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0032670 con 0x7f3cb4158c80 2024-08-17T02:26:11.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.877+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0177160 con 0x7ff9d0151700 2024-08-17T02:26:11.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7fa846a00640 1 -- 172.21.15.146:0/3342690521 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83802d050 con 0x7fa8480b3370 2024-08-17T02:26:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0179e50 con 0x7ff9d0151700 2024-08-17T02:26:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7fa846a00640 1 -- 172.21.15.146:0/3342690521 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838007900 con 0x7fa8480b3370 2024-08-17T02:26:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 -- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4158c80 msgr2=0x7f3cb40ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 --2- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4158c80 0x7f3cb40ce620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009850 tx=0x7f3ca00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b53200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b53200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b53200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c156670 con 0x7f8b4c155df0 2024-08-17T02:26:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b53200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0b0350 con 0x7f8b4c06df00 2024-08-17T02:26:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b53200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c06e5e0 con 0x7f8b4c155a20 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 -- 172.21.15.146:0/1796920354 shutdown_connections 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 --2- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb40cd700 0x7f3cb40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 --2- 172.21.15.146:0/1796920354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb4158c80 0x7f3cb40ce620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3cb3200640 1 -- 172.21.15.146:0/1796920354 >> 172.21.15.146:0/1796920354 conn(0x7f3cb4098e30 msgr2=0x7f3cb406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3adea00640 1 -- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ac4004780 msgr2=0x7f3ac4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3adea00640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ac4004780 0x7f3ac4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3adea00640 1 -- 172.21.15.146:0/1647611268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ac40051f0 msgr2=0x7f3ac400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f2aa6000640 1 --2- 172.21.15.146:0/3166430140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa006e7f0 0x7f2aa00adb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00afab0 tx=0x7f2a98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8f1f9c668c6257d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f2a9fe00640 1 -- 172.21.15.146:0/3166430140 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98007550 con 0x7f2aa006e7f0 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f2a9fe00640 1 -- 172.21.15.146:0/3166430140 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9802d050 con 0x7f2aa006e7f0 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3adea00640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ac40051f0 0x7f3ac400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.879+0000 7f3adea00640 1 -- 172.21.15.146:0/1647611268 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00b0640 con 0x7f3ac4003c30 2024-08-17T02:26:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3ade000640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ac4004780 0x7f3ac4004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f2a9fe00640 1 -- 172.21.15.146:0/3166430140 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98007920 con 0x7f2aa006e7f0 2024-08-17T02:26:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b51200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b51200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:40108/0 (socket says 172.21.15.146:40108) 2024-08-17T02:26:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f8b51200640 1 -- 172.21.15.146:0/4234731274 learned_addr learned my addr 172.21.15.146:0/4234731274 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.880+0000 7f3adf400640 1 -- 172.21.15.146:0/1647611268 reap_dead start 2024-08-17T02:26:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7fa84ea00640 1 -- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480b3370 msgr2=0x7fa8480b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7fa84ea00640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480b3370 0x7fa8480b37f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e60 tx=0x7fa838009780 comp rx=0 tx=0).stop 2024-08-17T02:26:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f3cb3200640 1 -- 172.21.15.146:0/1796920354 shutdown_connections 2024-08-17T02:26:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f3adea00640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ac4004020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c320 tx=0x7f3ad002a880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c939279c6d2398 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f92cd600640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 0x7f92b80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92d00a2380 con 0x7f92d81382f0 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f8b51200640 1 -- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 msgr2=0x7f8b4c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f8b51200640 1 --2- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f8b51200640 1 -- 172.21.15.146:0/4234731274 >> v1:172.21.15.150:6789/0 conn(0x7f8b4c155df0 legacy=0x7f8b4c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f8b51200640 1 -- 172.21.15.146:0/4234731274 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c06e8c0 con 0x7f8b4c06df00 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 -- 172.21.15.146:0/3166430140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa006e7f0 msgr2=0x7f2aa00adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 --2- 172.21.15.146:0/3166430140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa006e7f0 0x7f2aa00adb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00afab0 tx=0x7f2a98009780 comp rx=0 tx=0).stop 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.881+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005890 con 0x7f3ac4003c30 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0005a30 con 0x7f3ac4003c30 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f3add600640 1 -- 172.21.15.146:0/1647611268 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005df0 con 0x7f3ac4003c30 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7fa84ea00640 1 -- 172.21.15.146:0/3342690521 shutdown_connections 2024-08-17T02:26:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7fa84ea00640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480b3370 0x7fa8480b37f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7fa84ea00640 1 --2- 172.21.15.146:0/3342690521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f3cb3200640 1 -- 172.21.15.146:0/1796920354 wait complete. 2024-08-17T02:26:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7fa84ea00640 1 -- 172.21.15.146:0/3342690521 >> 172.21.15.146:0/3342690521 conn(0x7fa8480cfdf0 msgr2=0x7fa8480d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 -- 172.21.15.146:0/3166430140 shutdown_connections 2024-08-17T02:26:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 --2- 172.21.15.146:0/3166430140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa006e7f0 0x7f2aa00adb50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 --2- 172.21.15.146:0/3166430140 >> v2:172.21.15.146:3300/0 conn(0x7f2aa006a5e0 0x7f2aa013e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 -- 172.21.15.146:0/3166430140 >> 172.21.15.146:0/3166430140 conn(0x7f2aa00cc480 msgr2=0x7f2aa00687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 -- 172.21.15.146:0/3166430140 shutdown_connections 2024-08-17T02:26:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f2aa8000640 1 -- 172.21.15.146:0/3166430140 wait complete. 2024-08-17T02:26:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7fa84ea00640 1 -- 172.21.15.146:0/3342690521 shutdown_connections 2024-08-17T02:26:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7f8b51200640 1 --2- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009f20 tx=0x7f8b44009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b931a90bf33461 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7f92d5e00640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 0x7f92b80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7fa84ea00640 1 -- 172.21.15.146:0/3342690521 wait complete. 2024-08-17T02:26:11.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7f8b4aa00640 1 -- 172.21.15.146:0/4234731274 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44033430 con 0x7f8b4c06df00 2024-08-17T02:26:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7f8b4aa00640 1 -- 172.21.15.146:0/4234731274 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44033590 con 0x7f8b4c06df00 2024-08-17T02:26:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7f8b4aa00640 1 -- 172.21.15.146:0/4234731274 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44033930 con 0x7f8b4c06df00 2024-08-17T02:26:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.882+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9c8007300 con 0x7ff9d0151700 2024-08-17T02:26:11.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7ff9c6000640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 0x7ff9b00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.883+0000 7ff9cea00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 0x7ff9b00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9c80824f0 con 0x7ff9d0151700 2024-08-17T02:26:11.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7f2aa8000640 1 Processor -- start 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7fa84ea00640 1 Processor -- start 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7fa84ea00640 1 -- start start 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7f3cb3200640 1 Processor -- start 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7f3cb3200640 1 -- start start 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7f3ae5600640 1 -- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 msgr2=0x7f3ac4004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.884+0000 7f3ae5600640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ac4004020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c320 tx=0x7f3ad002a880 comp rx=0 tx=0).stop 2024-08-17T02:26:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f92d5e00640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 0x7f92b80676d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009a50 tx=0x7f92c8000f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f2aa8000640 1 -- start start 2024-08-17T02:26:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92d0070500 con 0x7f92d81382f0 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 -- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c06df00 msgr2=0x7f8b4c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 --2- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009f20 tx=0x7f8b44009840 comp rx=0 tx=0).stop 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f3ae5600640 1 -- 172.21.15.146:0/1647611268 shutdown_connections 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f3ae5600640 1 --2- 172.21.15.146:0/1647611268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ac4004020 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f3ae5600640 1 -- 172.21.15.146:0/1647611268 >> 172.21.15.146:0/1647611268 conn(0x7f3ae00cfdf0 msgr2=0x7f3ae00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 -- 172.21.15.146:0/4234731274 shutdown_connections 2024-08-17T02:26:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 --2- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c06df00 0x7f8b4c0ad9b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 --2- 172.21.15.146:0/4234731274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f8b53200640 1 -- 172.21.15.146:0/4234731274 >> 172.21.15.146:0/4234731274 conn(0x7f8b4c0cb9b0 msgr2=0x7f8b4c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.885+0000 7f3ae5600640 1 -- 172.21.15.146:0/1647611268 shutdown_connections 2024-08-17T02:26:11.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7f8b53200640 1 -- 172.21.15.146:0/4234731274 shutdown_connections 2024-08-17T02:26:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7f8b53200640 1 -- 172.21.15.146:0/4234731274 wait complete. 2024-08-17T02:26:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7ff9cea00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 0x7ff9b00676d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc034000 tx=0x7ff9bc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7f3ae5600640 1 -- 172.21.15.146:0/1647611268 wait complete. 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480ada10 0x7fa848155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8480b3370 0x7fa848154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481562e0 con 0x7fa8480b3370 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8481509f0 con 0x7fa8480ada10 2024-08-17T02:26:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa84ea00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480cde00 con 0x7fa8480b1120 2024-08-17T02:26:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aa006a5e0 0x7f2aa006dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa006e7f0 0x7f2aa0145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa01461b0 con 0x7f2aa006a5e0 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0139350 con 0x7f2aa013e2d0 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa8000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa006e250 con 0x7f2aa006e7f0 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:40126/0 (socket says 172.21.15.146:40126) 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 -- 172.21.15.146:0/1356250871 learned_addr learned my addr 172.21.15.146:0/1356250871 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 -- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa006e7f0 msgr2=0x7f2aa0145c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa006e7f0 0x7f2aa0145c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 -- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aa006a5e0 msgr2=0x7f2aa006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aa006a5e0 0x7f2aa006dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f2aa6000640 1 -- 172.21.15.146:0/1356250871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009a20 con 0x7f2aa013e2d0 2024-08-17T02:26:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7f3cb3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40cc800 0x7f3cb4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.886+0000 7fa847400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33578/0 (socket says 172.21.15.146:33578) 2024-08-17T02:26:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 -- 172.21.15.146:0/2305637025 learned_addr learned my addr 172.21.15.146:0/2305637025 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 -- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480ada10 msgr2=0x7fa848155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480ada10 0x7fa848155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 -- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8480b3370 msgr2=0x7fa848154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8480b3370 0x7fa848154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.887+0000 7fa847400640 1 -- 172.21.15.146:0/2305637025 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009a20 con 0x7fa8480b1120 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7fa847400640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa83000c880 tx=0x7fa830008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000ce10 con 0x7fa8480b1120 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830007890 con 0x7fa8480b1120 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830007c10 con 0x7fa8480b1120 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480ce0e0 con 0x7fa8480b1120 2024-08-17T02:26:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa848152680 con 0x7fa8480b1120 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f8b53200640 1 Processor -- start 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 0x7f3cb4159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb1400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb1400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:40136/0 (socket says 172.21.15.146:40136) 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb1400640 1 -- 172.21.15.146:0/3814290022 learned_addr learned my addr 172.21.15.146:0/3814290022 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b4e30 con 0x7f3cb40cc800 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b4220 con 0x7f3cb40cd700 2024-08-17T02:26:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b4500 con 0x7f3cb4158c80 2024-08-17T02:26:11.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb2800640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 0x7f3cb4159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3ae5600640 1 Processor -- start 2024-08-17T02:26:11.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f3ae5600640 1 -- start start 2024-08-17T02:26:11.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f8b53200640 1 -- start start 2024-08-17T02:26:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40cc800 0x7f3cb4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1400640 1 -- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 msgr2=0x7f3cb4159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1400640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 0x7f3cb4159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.888+0000 7f2aa6000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009e90 tx=0x7f2a98035000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a980318b0 con 0x7f2aa013e2d0 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1400640 1 -- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40cc800 msgr2=0x7f3cb4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1400640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40cc800 0x7f3cb4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f3cb1400640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009390 con 0x7f3cb40cd700 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a98040070 con 0x7f2aa013e2d0 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98031c40 con 0x7f2aa013e2d0 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.889+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0139600 con 0x7f2aa013e2d0 2024-08-17T02:26:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.890+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa0139bc0 con 0x7f2aa013e2d0 2024-08-17T02:26:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.890+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9d0179e50 con 0x7ff9d0151700 2024-08-17T02:26:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.890+0000 7f3cb2800640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 0x7f3cb4159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.891+0000 7f3ae5600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ae006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.891+0000 7f3ae5600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 0x7f3ae0168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.891+0000 7f3ae5600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.891+0000 7f3cb1400640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400ea00 tx=0x7f3ca40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.891+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa0139e10 con 0x7f2aa013e2d0 2024-08-17T02:26:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400ca10 con 0x7f3cb40cd700 2024-08-17T02:26:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ae5600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01553c0 con 0x7f3ae0155520 2024-08-17T02:26:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ae5600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0155990 con 0x7f3ac4003c30 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3adf400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ade000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 0x7f3ae0168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3adf400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33606/0 (socket says 172.21.15.146:33606) 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3adf400640 1 -- 172.21.15.146:0/3741971516 learned_addr learned my addr 172.21.15.146:0/3741971516 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0155c20 con 0x7f3ae01583c0 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb40b47e0 con 0x7f3cb40cd700 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400cb70 con 0x7f3cb40cd700 2024-08-17T02:26:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400ca10 con 0x7f3cb40cd700 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 0x7f8b4c14c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c155df0 0x7f8b4c14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c151740 con 0x7f8b4c06df00 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c150890 con 0x7f8b4c155df0 2024-08-17T02:26:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7f8b53200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c150b30 con 0x7f8b4c155a20 2024-08-17T02:26:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2a98042030 con 0x7f2aa013e2d0 2024-08-17T02:26:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa8300113f0 con 0x7fa8480b1120 2024-08-17T02:26:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.892+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa848158a60 con 0x7fa8480b1120 2024-08-17T02:26:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4b400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 0x7f8b4c14c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4b400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c168730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:33618/0 (socket says 172.21.15.146:33618) 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4b400640 1 -- 172.21.15.146:0/3800526223 learned_addr learned my addr 172.21.15.146:0/3800526223 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b51200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c155df0 0x7f8b4c14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f3ade000640 1 -- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 msgr2=0x7f3ae01511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f3ade000640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 -- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 msgr2=0x7f8b4c168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 -- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c155df0 msgr2=0x7f8b4c14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c155df0 0x7f8b4c14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f8b4be00640 1 -- 172.21.15.146:0/3800526223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009ae0 con 0x7f8b4c06df00 2024-08-17T02:26:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f3ade000640 1 -- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 msgr2=0x7f3ae006de50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:26:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7fa83f400640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 0x7fa824067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7f2a9cc00640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 0x7f2a800676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa830082480 con 0x7fa8480b1120 2024-08-17T02:26:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a980a3650 con 0x7f2aa013e2d0 2024-08-17T02:26:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7f8b4be00640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 0x7f8b4c14c180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800b560 tx=0x7f8b38009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7f2aa5600640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 0x7f2a800676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800f510 con 0x7f8b4c06df00 2024-08-17T02:26:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.895+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800f670 con 0x7f8b4c06df00 2024-08-17T02:26:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.895+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800fa10 con 0x7f8b4c06df00 2024-08-17T02:26:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.895+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c150e10 con 0x7f8b4c06df00 2024-08-17T02:26:11.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.895+0000 7f2aa5600640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 0x7f2a800676d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c001530 tx=0x7f2a8c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.894+0000 7fa847e00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 0x7fa824067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.895+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c1513d0 con 0x7f8b4c06df00 2024-08-17T02:26:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.893+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb40b3ef0 con 0x7f3cb40cd700 2024-08-17T02:26:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.897+0000 7fa847e00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 0x7fa824067750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa840007fd0 tx=0x7fa840007a70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.897+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c064db0 con 0x7f8b4c06df00 2024-08-17T02:26:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.896+0000 7f3adea00640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ae006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa848158a60 con 0x7fa8480b1120 2024-08-17T02:26:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3ade000640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ae006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3ade000640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0155f00 con 0x7f3ae0155520 2024-08-17T02:26:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3adf400640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3adea00640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ae006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2a98071700 con 0x7f2aa013e2d0 2024-08-17T02:26:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.896+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ca4013470 con 0x7f3cb40cd700 2024-08-17T02:26:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.896+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4071050 con 0x7f3cb40cd700 2024-08-17T02:26:11.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3ade000640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 0x7f3ae0168650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3acc001520 tx=0x7f3acc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.898+0000 7f3ca9600640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 0x7f3c94067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.899+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 0x7f3c94067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.899+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc010520 con 0x7f3ae0155520 2024-08-17T02:26:11.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.899+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae01561e0 con 0x7f3ae0155520 2024-08-17T02:26:11.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.900+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae0168130 con 0x7f3ae0155520 2024-08-17T02:26:11.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.900+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ca4053a30 con 0x7f3cb40cd700 2024-08-17T02:26:11.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.900+0000 7f3cb1e00640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 0x7f3c94067660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0034000 tx=0x7f3ca0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.900+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc007100 con 0x7f3ae0155520 2024-08-17T02:26:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.901+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b3801a400 con 0x7f8b4c06df00 2024-08-17T02:26:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.903+0000 7f8b43400640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 0x7f8b2c067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.903+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b38081e30 con 0x7f8b4c06df00 2024-08-17T02:26:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.904+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ca4050500 con 0x7f3cb40cd700 2024-08-17T02:26:11.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.904+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8005210 con 0x7f3ae0155520 2024-08-17T02:26:11.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.908+0000 7f8b4b400640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 0x7f8b2c067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.908+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc010890 con 0x7f3ae0155520 2024-08-17T02:26:11.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.910+0000 7f8b4b400640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 0x7f8b2c067780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0ad4f0 tx=0x7f8b3c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.911+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3acc010a30 con 0x7f3ae0155520 2024-08-17T02:26:11.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.913+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b3804ff50 con 0x7f8b4c06df00 2024-08-17T02:26:11.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.915+0000 7f3ad6000640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 0x7f3ac0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.915+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3acc082870 con 0x7f3ae0155520 2024-08-17T02:26:11.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.915+0000 7f3adea00640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 0x7f3ac0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.917+0000 7f3adea00640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 0x7f3ac0067630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0033000 tx=0x7f3ad0034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:11.922+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3acc04fd70 con 0x7f3ae0155520 2024-08-17T02:26:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.193+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4bf8005790 con 0x7f4c2415d4b0 2024-08-17T02:26:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.194+0000 7f4c16a00640 1 -- 172.21.15.146:0/1006694000 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c1c053850 con 0x7f4c2415d4b0 2024-08-17T02:26:12.200 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2024-08-17T02:26:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.200+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 msgr2=0x7f4c04067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.200+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 0x7f4c04067660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c10034000 tx=0x7f4c10032000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.200+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 msgr2=0x7f4c24159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.200+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00cc90 tx=0x7f4c1c001ab0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 shutdown_connections 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4c040651b0 0x7f4c04067660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c2415cba0 0x7f4c240af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c2415d4b0 0x7f4c24159d30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 --2- 172.21.15.146:0/1006694000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4c2415c200 0x7f4c240c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 >> 172.21.15.146:0/1006694000 conn(0x7f4c2406eb90 msgr2=0x7f4c240684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 shutdown_connections 2024-08-17T02:26:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.201+0000 7f4c0be00640 1 -- 172.21.15.146:0/1006694000 wait complete. 2024-08-17T02:26:12.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-08-17T02:26:12.227 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.262+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8b4c157c90 con 0x7f8b4c06df00 2024-08-17T02:26:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.262+0000 7f8b43400640 1 -- 172.21.15.146:0/3800526223 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b38053570 con 0x7f8b4c06df00 2024-08-17T02:26:12.265 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 msgr2=0x7f8b2c067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 0x7f8b2c067780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0ad4f0 tx=0x7f8b3c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 msgr2=0x7f8b4c14c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 0x7f8b4c14c180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800b560 tx=0x7f8b38009120 comp rx=0 tx=0).stop 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 shutdown_connections 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8b2c0652d0 0x7f8b2c067780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b4c155df0 0x7f8b4c14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b4c155a20 0x7f8b4c168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 --2- 172.21.15.146:0/3800526223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b4c06df00 0x7f8b4c14c180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 >> 172.21.15.146:0/3800526223 conn(0x7f8b4c0cb9b0 msgr2=0x7f8b4c0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 shutdown_connections 2024-08-17T02:26:12.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.265+0000 7f8b53200640 1 -- 172.21.15.146:0/3800526223 wait complete. 2024-08-17T02:26:12.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-08-17T02:26:12.281 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.304+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92b0005790 con 0x7f92d81382f0 2024-08-17T02:26:12.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.304+0000 7f92cd600640 1 -- 172.21.15.146:0/3779416979 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92d0073b20 con 0x7f92d81382f0 2024-08-17T02:26:12.306 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:12.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.306+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2aa0064db0 con 0x7f2aa013e2d0 2024-08-17T02:26:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 msgr2=0x7f92b80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 0x7f92b80676d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009a50 tx=0x7f92c8000f90 comp rx=0 tx=0).stop 2024-08-17T02:26:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f2a9cc00640 1 -- 172.21.15.146:0/1356250871 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a98074d20 con 0x7f2aa013e2d0 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 msgr2=0x7f92d813cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 0x7f92d813cd30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92d8070900 tx=0x7f92d0034000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 shutdown_connections 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f92b8065220 0x7f92b80676d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d81444c0 0x7f92d8137db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92d81382f0 0x7f92d813cd30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 --2- 172.21.15.146:0/3779416979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92bc005380 0x7f92d8140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 >> 172.21.15.146:0/3779416979 conn(0x7f92d80cb7a0 msgr2=0x7f92d81471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.309 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 shutdown_connections 2024-08-17T02:26:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.307+0000 7f92dd000640 1 -- 172.21.15.146:0/3779416979 wait complete. 2024-08-17T02:26:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.308+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa848158a60 con 0x7fa8480b1120 2024-08-17T02:26:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.309+0000 7fa83f400640 1 -- 172.21.15.146:0/2305637025 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa848158a60 con 0x7fa8480b1120 2024-08-17T02:26:12.311 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.310+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 msgr2=0x7f2a800676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.310+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 0x7f2a800676d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c001530 tx=0x7f2a8c007ac0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.310+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 msgr2=0x7f2aa01581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.310+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009e90 tx=0x7f2a98035000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 shutdown_connections 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2a80065220 0x7f2a800676d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2aa013e2d0 0x7f2aa01581d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2aa006e7f0 0x7f2aa0145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 --2- 172.21.15.146:0/1356250871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aa006a5e0 0x7f2aa006dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 >> 172.21.15.146:0/1356250871 conn(0x7f2aa00cc480 msgr2=0x7f2aa013cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 shutdown_connections 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.311+0000 7f2aa8000640 1 -- 172.21.15.146:0/1356250871 wait complete. 2024-08-17T02:26:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 msgr2=0x7fa824067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 0x7fa824067750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa840007fd0 tx=0x7fa840007a70 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 msgr2=0x7fa8480ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa83000c880 tx=0x7fa830008040 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 shutdown_connections 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa8240652a0 0x7fa824067750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8480b3370 0x7fa848154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8480b1120 0x7fa8480ae010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 --2- 172.21.15.146:0/2305637025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8480ada10 0x7fa848155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.312+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 >> 172.21.15.146:0/2305637025 conn(0x7fa8480cfdf0 msgr2=0x7fa8480d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.313+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 shutdown_connections 2024-08-17T02:26:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.313+0000 7fa84ea00640 1 -- 172.21.15.146:0/2305637025 wait complete. 2024-08-17T02:26:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.313+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9d0179e50 con 0x7ff9d0151700 2024-08-17T02:26:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.313+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3cb40b4f70 con 0x7f3cb40cd700 2024-08-17T02:26:12.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.314+0000 7ff9c6000640 1 -- 172.21.15.146:0/2923040835 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9d0179e50 con 0x7ff9d0151700 2024-08-17T02:26:12.316 INFO:teuthology.orchestra.run.smithi146.stdout:55834574853 2024-08-17T02:26:12.316 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-08-17T02:26:12.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.314+0000 7f3ca9600640 1 -- 172.21.15.146:0/3814290022 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ca40506a0 con 0x7f3cb40cd700 2024-08-17T02:26:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 msgr2=0x7ff9b00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 0x7ff9b00676d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc034000 tx=0x7ff9bc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 msgr2=0x7ff9d0151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 0x7ff9d0151b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8002230 tx=0x7ff9c8001a30 comp rx=0 tx=0).stop 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 shutdown_connections 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b0065220 0x7ff9b00676d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d0151700 0x7ff9d0151b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d013b4e0 0x7ff9d015aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 --2- 172.21.15.146:0/2923040835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d013b110 0x7ff9d014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.317+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 >> 172.21.15.146:0/2923040835 conn(0x7ff9d00cb7a0 msgr2=0x7ff9d006d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 msgr2=0x7f3c94067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 shutdown_connections 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7ff9d5e00640 1 -- 172.21.15.146:0/2923040835 wait complete. 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 0x7f3c94067660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0034000 tx=0x7f3ca0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 msgr2=0x7f3cb40b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400ea00 tx=0x7f3ca40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 shutdown_connections 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3c940651b0 0x7f3c94067660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cb4158c80 0x7f3cb4159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cb40cd700 0x7f3cb40b52c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 --2- 172.21.15.146:0/3814290022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb40cc800 0x7f3cb4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 >> 172.21.15.146:0/3814290022 conn(0x7f3cb4098e30 msgr2=0x7f3cb40681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 shutdown_connections 2024-08-17T02:26:12.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.318+0000 7f3cb3200640 1 -- 172.21.15.146:0/3814290022 wait complete. 2024-08-17T02:26:12.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.324+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3ab80054c0 con 0x7f3ae0155520 2024-08-17T02:26:12.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.325+0000 7f3ad6000640 1 -- 172.21.15.146:0/3741971516 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3acc019020 con 0x7f3ae0155520 2024-08-17T02:26:12.326 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-08-17T02:26:12.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 msgr2=0x7f3ac0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 0x7f3ac0067630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0033000 tx=0x7f3ad0034000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 msgr2=0x7f3ae0168650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 0x7f3ae0168650 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3acc001520 tx=0x7f3acc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 shutdown_connections 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3ac0065180 0x7f3ac0067630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0155520 0x7f3ae0168650 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ae01583c0 0x7f3ae01511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 --2- 172.21.15.146:0/3741971516 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ac4003c30 0x7f3ae006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 >> 172.21.15.146:0/3741971516 conn(0x7f3ae00cfdf0 msgr2=0x7f3ae0067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.328+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 shutdown_connections 2024-08-17T02:26:12.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.329+0000 7f3ae5600640 1 -- 172.21.15.146:0/3741971516 wait complete. 2024-08-17T02:26:12.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-08-17T02:26:12.334 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-08-17T02:26:12.336 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-08-17T02:26:12.344 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-08-17T02:26:12.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-17T02:26:12.347 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.348 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-08-17T02:26:12.349 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:12.349 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:26:12.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:12.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.538+0000 7f586ac00640 1 Processor -- start 2024-08-17T02:26:12.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.538+0000 7f586ac00640 1 -- start start 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.539+0000 7f586ac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f58640caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f586ac00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58640b1440 0x7f58640c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f586ac00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640caa80 con 0x7f5864140580 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f586ac00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640cb450 con 0x7f58640b1440 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f586ac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640c9e70 con 0x7f58641401b0 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f585b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5864140580 0x7f58640b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55970/0 (socket says 172.21.15.146:55970) 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f585b400640 1 -- 172.21.15.146:0/16977535 learned_addr learned my addr 172.21.15.146:0/16977535 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863e00640 1 --2- 172.21.15.146:0/16977535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f58640caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5868c00640 1 --2- 172.21.15.146:0/16977535 >> v2:172.21.15.150:3300/0 conn(0x7f58640b1440 0x7f58640c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863400640 1 -- 172.21.15.146:0/16977535 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547154947 0 0) 0x7f58640caa80 con 0x7f5864140580 2024-08-17T02:26:12.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863400640 1 -- 172.21.15.146:0/16977535 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58480034e0 con 0x7f5864140580 2024-08-17T02:26:12.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863e00640 1 -- 172.21.15.146:0/16977535 >> v2:172.21.15.150:3300/0 conn(0x7f58640b1440 msgr2=0x7f58640c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863e00640 1 --2- 172.21.15.146:0/16977535 >> v2:172.21.15.150:3300/0 conn(0x7f58640b1440 0x7f58640c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863e00640 1 -- 172.21.15.146:0/16977535 >> v1:172.21.15.146:6789/0 conn(0x7f5864140580 legacy=0x7f58640b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.540+0000 7f5863e00640 1 -- 172.21.15.146:0/16977535 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640ca150 con 0x7f58641401b0 2024-08-17T02:26:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f5863e00640 1 --2- 172.21.15.146:0/16977535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f58640caf10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5854009850 tx=0x7f58540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a4569537d0e93d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f5863400640 1 -- 172.21.15.146:0/16977535 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585402ad00 con 0x7f58641401b0 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f5863400640 1 -- 172.21.15.146:0/16977535 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585402ae60 con 0x7f58641401b0 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f5863400640 1 -- 172.21.15.146:0/16977535 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854032670 con 0x7f58641401b0 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 -- 172.21.15.146:0/16977535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 msgr2=0x7f58640caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 --2- 172.21.15.146:0/16977535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f58640caf10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5854009850 tx=0x7f58540090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 -- 172.21.15.146:0/16977535 shutdown_connections 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 --2- 172.21.15.146:0/16977535 >> v2:172.21.15.150:3300/0 conn(0x7f58640b1440 0x7f58640c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 --2- 172.21.15.146:0/16977535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f58640caf10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 -- 172.21.15.146:0/16977535 >> 172.21.15.146:0/16977535 conn(0x7f58640cb9b0 msgr2=0x7f58640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 -- 172.21.15.146:0/16977535 shutdown_connections 2024-08-17T02:26:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.542+0000 7f586ac00640 1 -- 172.21.15.146:0/16977535 wait complete. 2024-08-17T02:26:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.544+0000 7f586ac00640 1 Processor -- start 2024-08-17T02:26:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.544+0000 7f586ac00640 1 -- start start 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f586413ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 0x7f58640687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586414a5e0 con 0x7f58640b1440 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586413ac80 con 0x7f5864140580 2024-08-17T02:26:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f586ac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586413d920 con 0x7f58641401b0 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40522/0 (socket says 172.21.15.146:40522) 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 -- 172.21.15.146:0/55245831 learned_addr learned my addr 172.21.15.146:0/55245831 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5868c00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 0x7f58640687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f585b400640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f586413ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 -- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 msgr2=0x7f586413ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f586413ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 -- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 msgr2=0x7f58640687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 0x7f58640687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5863e00640 1 -- 172.21.15.146:0/55245831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5854009390 con 0x7f58640b1440 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.545+0000 7f5868c00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 0x7f58640687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f5863e00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5854009360 tx=0x7f5854032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585403b6e0 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585403b840 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586413dc00 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585403bc00 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.546+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586413e1c0 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.547+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5864064db0 con 0x7f58640b1440 2024-08-17T02:26:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.548+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5854043030 con 0x7f58640b1440 2024-08-17T02:26:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.549+0000 7f585be00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 0x7f5840067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.549+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5854041070 con 0x7f58640b1440 2024-08-17T02:26:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.549+0000 7f585b400640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 0x7f5840067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.549+0000 7f585b400640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 0x7f5840067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f586416c290 tx=0x7f584c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.553+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f58540709d0 con 0x7f58640b1440 2024-08-17T02:26:12.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.723+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f586414a720 con 0x7f5840065150 2024-08-17T02:26:12.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.731+0000 7f585be00640 1 -- 172.21.15.146:0/55245831 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264506 (secure 0 0 0) 0x7f584c0013f0 con 0x7f5840065150 2024-08-17T02:26:12.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:12.737 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:12.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 msgr2=0x7f5840067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 0x7f5840067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f586416c290 tx=0x7f584c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 msgr2=0x7f586413a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5854009360 tx=0x7f5854032000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 shutdown_connections 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5840065150 0x7f5840067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5864140580 0x7f58640687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58641401b0 0x7f586413ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 --2- 172.21.15.146:0/55245831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58640b1440 0x7f586413a740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 >> 172.21.15.146:0/55245831 conn(0x7f58640cb9b0 msgr2=0x7f58640aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 shutdown_connections 2024-08-17T02:26:12.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.735+0000 7f586ac00640 1 -- 172.21.15.146:0/55245831 wait complete. 2024-08-17T02:26:12.751 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:26:12.325066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381688,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593032,"statfs":{"total":773094113280,"available":770655264768,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.658543"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710211+0000","last_change":"2024-08-17T02:26:03.706448+0000","last_active":"2024-08-17T02:26:03.710211+0000","last_peered":"2024-08-17T02:26:03.710211+0000","last_clean":"2024-08-17T02:26:03.710211+0000","last_became_active":"2024-08-17T02:26:03.691979+0000","last_became_peered":"2024-08-17T02:26:03.691979+0000","last_unstale":"2024-08-17T02:26:03.710211+0000","last_undegraded":"2024-08-17T02:26:03.710211+0000","last_fullsized":"2024-08-17T02:26:03.710211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686603+0000","last_change":"2024-08-17T02:26:03.683666+0000","last_active":"2024-08-17T02:26:03.686603+0000","last_peered":"2024-08-17T02:26:03.686603+0000","last_clean":"2024-08-17T02:26:03.686603+0000","last_became_active":"2024-08-17T02:26:03.683431+0000","last_became_peered":"2024-08-17T02:26:03.683431+0000","last_unstale":"2024-08-17T02:26:03.686603+0000","last_undegraded":"2024-08-17T02:26:03.686603+0000","last_fullsized":"2024-08-17T02:26:03.686603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686845+0000","last_change":"2024-08-17T02:26:03.684515+0000","last_active":"2024-08-17T02:26:03.686845+0000","last_peered":"2024-08-17T02:26:03.686845+0000","last_clean":"2024-08-17T02:26:03.686845+0000","last_became_active":"2024-08-17T02:26:03.684225+0000","last_became_peered":"2024-08-17T02:26:03.684225+0000","last_unstale":"2024-08-17T02:26:03.686845+0000","last_undegraded":"2024-08-17T02:26:03.686845+0000","last_fullsized":"2024-08-17T02:26:03.686845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:48.325629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700394+0000","last_change":"2024-08-17T02:26:03.695442+0000","last_active":"2024-08-17T02:26:03.700394+0000","last_peered":"2024-08-17T02:26:03.700394+0000","last_clean":"2024-08-17T02:26:03.700394+0000","last_became_active":"2024-08-17T02:26:03.694771+0000","last_became_peered":"2024-08-17T02:26:03.694771+0000","last_unstale":"2024-08-17T02:26:03.700394+0000","last_undegraded":"2024-08-17T02:26:03.700394+0000","last_fullsized":"2024-08-17T02:26:03.700394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706316+0000","last_change":"2024-08-17T02:26:03.691208+0000","last_active":"2024-08-17T02:26:03.706316+0000","last_peered":"2024-08-17T02:26:03.706316+0000","last_clean":"2024-08-17T02:26:03.706316+0000","last_became_active":"2024-08-17T02:26:03.690708+0000","last_became_peered":"2024-08-17T02:26:03.690708+0000","last_unstale":"2024-08-17T02:26:03.706316+0000","last_undegraded":"2024-08-17T02:26:03.706316+0000","last_fullsized":"2024-08-17T02:26:03.706316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700594+0000","last_change":"2024-08-17T02:26:03.696680+0000","last_active":"2024-08-17T02:26:03.700594+0000","last_peered":"2024-08-17T02:26:03.700594+0000","last_clean":"2024-08-17T02:26:03.700594+0000","last_became_active":"2024-08-17T02:26:03.696347+0000","last_became_peered":"2024-08-17T02:26:03.696347+0000","last_unstale":"2024-08-17T02:26:03.700594+0000","last_undegraded":"2024-08-17T02:26:03.700594+0000","last_fullsized":"2024-08-17T02:26:03.700594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705465+0000","last_change":"2024-08-17T02:26:03.690098+0000","last_active":"2024-08-17T02:26:03.705465+0000","last_peered":"2024-08-17T02:26:03.705465+0000","last_clean":"2024-08-17T02:26:03.705465+0000","last_became_active":"2024-08-17T02:26:03.688253+0000","last_became_peered":"2024-08-17T02:26:03.688253+0000","last_unstale":"2024-08-17T02:26:03.705465+0000","last_undegraded":"2024-08-17T02:26:03.705465+0000","last_fullsized":"2024-08-17T02:26:03.705465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707688+0000","last_change":"2024-08-17T02:26:03.704945+0000","last_active":"2024-08-17T02:26:03.707688+0000","last_peered":"2024-08-17T02:26:03.707688+0000","last_clean":"2024-08-17T02:26:03.707688+0000","last_became_active":"2024-08-17T02:26:03.704138+0000","last_became_peered":"2024-08-17T02:26:03.704138+0000","last_unstale":"2024-08-17T02:26:03.707688+0000","last_undegraded":"2024-08-17T02:26:03.707688+0000","last_fullsized":"2024-08-17T02:26:03.707688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710295+0000","last_change":"2024-08-17T02:26:03.707594+0000","last_active":"2024-08-17T02:26:03.710295+0000","last_peered":"2024-08-17T02:26:03.710295+0000","last_clean":"2024-08-17T02:26:03.710295+0000","last_became_active":"2024-08-17T02:26:03.707040+0000","last_became_peered":"2024-08-17T02:26:03.707040+0000","last_unstale":"2024-08-17T02:26:03.710295+0000","last_undegraded":"2024-08-17T02:26:03.710295+0000","last_fullsized":"2024-08-17T02:26:03.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.711882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710990+0000","last_change":"2024-08-17T02:26:03.699269+0000","last_active":"2024-08-17T02:26:03.710990+0000","last_peered":"2024-08-17T02:26:03.710990+0000","last_clean":"2024-08-17T02:26:03.710990+0000","last_became_active":"2024-08-17T02:26:03.698978+0000","last_became_peered":"2024-08-17T02:26:03.698978+0000","last_unstale":"2024-08-17T02:26:03.710990+0000","last_undegraded":"2024-08-17T02:26:03.710990+0000","last_fullsized":"2024-08-17T02:26:03.710990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709665+0000","last_change":"2024-08-17T02:26:03.699531+0000","last_active":"2024-08-17T02:26:03.709665+0000","last_peered":"2024-08-17T02:26:03.709665+0000","last_clean":"2024-08-17T02:26:03.709665+0000","last_became_active":"2024-08-17T02:26:03.699231+0000","last_became_peered":"2024-08-17T02:26:03.699231+0000","last_unstale":"2024-08-17T02:26:03.709665+0000","last_undegraded":"2024-08-17T02:26:03.709665+0000","last_fullsized":"2024-08-17T02:26:03.709665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705036+0000","last_change":"2024-08-17T02:26:03.699887+0000","last_active":"2024-08-17T02:26:03.705036+0000","last_peered":"2024-08-17T02:26:03.705036+0000","last_clean":"2024-08-17T02:26:03.705036+0000","last_became_active":"2024-08-17T02:26:03.699594+0000","last_became_peered":"2024-08-17T02:26:03.699594+0000","last_unstale":"2024-08-17T02:26:03.705036+0000","last_undegraded":"2024-08-17T02:26:03.705036+0000","last_fullsized":"2024-08-17T02:26:03.705036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:07.573229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708999+0000","last_change":"2024-08-17T02:26:03.701254+0000","last_active":"2024-08-17T02:26:03.708999+0000","last_peered":"2024-08-17T02:26:03.708999+0000","last_clean":"2024-08-17T02:26:03.708999+0000","last_became_active":"2024-08-17T02:26:03.700989+0000","last_became_peered":"2024-08-17T02:26:03.700989+0000","last_unstale":"2024-08-17T02:26:03.708999+0000","last_undegraded":"2024-08-17T02:26:03.708999+0000","last_fullsized":"2024-08-17T02:26:03.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683122+0000","last_change":"2024-08-17T02:26:03.680779+0000","last_active":"2024-08-17T02:26:03.683122+0000","last_peered":"2024-08-17T02:26:03.683122+0000","last_clean":"2024-08-17T02:26:03.683122+0000","last_became_active":"2024-08-17T02:26:03.678795+0000","last_became_peered":"2024-08-17T02:26:03.678795+0000","last_unstale":"2024-08-17T02:26:03.683122+0000","last_undegraded":"2024-08-17T02:26:03.683122+0000","last_fullsized":"2024-08-17T02:26:03.683122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702298+0000","last_change":"2024-08-17T02:26:03.700633+0000","last_active":"2024-08-17T02:26:03.702298+0000","last_peered":"2024-08-17T02:26:03.702298+0000","last_clean":"2024-08-17T02:26:03.702298+0000","last_became_active":"2024-08-17T02:26:03.700302+0000","last_became_peered":"2024-08-17T02:26:03.700302+0000","last_unstale":"2024-08-17T02:26:03.702298+0000","last_undegraded":"2024-08-17T02:26:03.702298+0000","last_fullsized":"2024-08-17T02:26:03.702298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700498+0000","last_change":"2024-08-17T02:26:03.696556+0000","last_active":"2024-08-17T02:26:03.700498+0000","last_peered":"2024-08-17T02:26:03.700498+0000","last_clean":"2024-08-17T02:26:03.700498+0000","last_became_active":"2024-08-17T02:26:03.696283+0000","last_became_peered":"2024-08-17T02:26:03.696283+0000","last_unstale":"2024-08-17T02:26:03.700498+0000","last_undegraded":"2024-08-17T02:26:03.700498+0000","last_fullsized":"2024-08-17T02:26:03.700498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713422+0000","last_change":"2024-08-17T02:26:03.711711+0000","last_active":"2024-08-17T02:26:03.713422+0000","last_peered":"2024-08-17T02:26:03.713422+0000","last_clean":"2024-08-17T02:26:03.713422+0000","last_became_active":"2024-08-17T02:26:03.711488+0000","last_became_peered":"2024-08-17T02:26:03.711488+0000","last_unstale":"2024-08-17T02:26:03.713422+0000","last_undegraded":"2024-08-17T02:26:03.713422+0000","last_fullsized":"2024-08-17T02:26:03.713422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699741+0000","last_change":"2024-08-17T02:26:03.697674+0000","last_active":"2024-08-17T02:26:03.699741+0000","last_peered":"2024-08-17T02:26:03.699741+0000","last_clean":"2024-08-17T02:26:03.699741+0000","last_became_active":"2024-08-17T02:26:03.694701+0000","last_became_peered":"2024-08-17T02:26:03.694701+0000","last_unstale":"2024-08-17T02:26:03.699741+0000","last_undegraded":"2024-08-17T02:26:03.699741+0000","last_fullsized":"2024-08-17T02:26:03.699741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708484+0000","last_change":"2024-08-17T02:26:03.700361+0000","last_active":"2024-08-17T02:26:03.708484+0000","last_peered":"2024-08-17T02:26:03.708484+0000","last_clean":"2024-08-17T02:26:03.708484+0000","last_became_active":"2024-08-17T02:26:03.691498+0000","last_became_peered":"2024-08-17T02:26:03.691498+0000","last_unstale":"2024-08-17T02:26:03.708484+0000","last_undegraded":"2024-08-17T02:26:03.708484+0000","last_fullsized":"2024-08-17T02:26:03.708484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709665+0000","last_change":"2024-08-17T02:26:03.703171+0000","last_active":"2024-08-17T02:26:03.709665+0000","last_peered":"2024-08-17T02:26:03.709665+0000","last_clean":"2024-08-17T02:26:03.709665+0000","last_became_active":"2024-08-17T02:26:03.701780+0000","last_became_peered":"2024-08-17T02:26:03.701780+0000","last_unstale":"2024-08-17T02:26:03.709665+0000","last_undegraded":"2024-08-17T02:26:03.709665+0000","last_fullsized":"2024-08-17T02:26:03.709665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.689568+0000","last_change":"2024-08-17T02:26:03.684338+0000","last_active":"2024-08-17T02:26:03.689568+0000","last_peered":"2024-08-17T02:26:03.689568+0000","last_clean":"2024-08-17T02:26:03.689568+0000","last_became_active":"2024-08-17T02:26:03.683895+0000","last_became_peered":"2024-08-17T02:26:03.683895+0000","last_unstale":"2024-08-17T02:26:03.689568+0000","last_undegraded":"2024-08-17T02:26:03.689568+0000","last_fullsized":"2024-08-17T02:26:03.689568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710670+0000","last_change":"2024-08-17T02:26:03.708118+0000","last_active":"2024-08-17T02:26:03.710670+0000","last_peered":"2024-08-17T02:26:03.710670+0000","last_clean":"2024-08-17T02:26:03.710670+0000","last_became_active":"2024-08-17T02:26:03.707028+0000","last_became_peered":"2024-08-17T02:26:03.707028+0000","last_unstale":"2024-08-17T02:26:03.710670+0000","last_undegraded":"2024-08-17T02:26:03.710670+0000","last_fullsized":"2024-08-17T02:26:03.710670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701029+0000","last_change":"2024-08-17T02:26:03.698278+0000","last_active":"2024-08-17T02:26:03.701029+0000","last_peered":"2024-08-17T02:26:03.701029+0000","last_clean":"2024-08-17T02:26:03.701029+0000","last_became_active":"2024-08-17T02:26:03.698031+0000","last_became_peered":"2024-08-17T02:26:03.698031+0000","last_unstale":"2024-08-17T02:26:03.701029+0000","last_undegraded":"2024-08-17T02:26:03.701029+0000","last_fullsized":"2024-08-17T02:26:03.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700258+0000","last_change":"2024-08-17T02:26:03.694710+0000","last_active":"2024-08-17T02:26:03.700258+0000","last_peered":"2024-08-17T02:26:03.700258+0000","last_clean":"2024-08-17T02:26:03.700258+0000","last_became_active":"2024-08-17T02:26:03.693342+0000","last_became_peered":"2024-08-17T02:26:03.693342+0000","last_unstale":"2024-08-17T02:26:03.700258+0000","last_undegraded":"2024-08-17T02:26:03.700258+0000","last_fullsized":"2024-08-17T02:26:03.700258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701083+0000","last_change":"2024-08-17T02:26:03.698485+0000","last_active":"2024-08-17T02:26:03.701083+0000","last_peered":"2024-08-17T02:26:03.701083+0000","last_clean":"2024-08-17T02:26:03.701083+0000","last_became_active":"2024-08-17T02:26:03.698183+0000","last_became_peered":"2024-08-17T02:26:03.698183+0000","last_unstale":"2024-08-17T02:26:03.701083+0000","last_undegraded":"2024-08-17T02:26:03.701083+0000","last_fullsized":"2024-08-17T02:26:03.701083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713035+0000","last_change":"2024-08-17T02:26:03.707593+0000","last_active":"2024-08-17T02:26:03.713035+0000","last_peered":"2024-08-17T02:26:03.713035+0000","last_clean":"2024-08-17T02:26:03.713035+0000","last_became_active":"2024-08-17T02:26:03.707341+0000","last_became_peered":"2024-08-17T02:26:03.707341+0000","last_unstale":"2024-08-17T02:26:03.713035+0000","last_undegraded":"2024-08-17T02:26:03.713035+0000","last_fullsized":"2024-08-17T02:26:03.713035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704094+0000","last_change":"2024-08-17T02:26:03.693165+0000","last_active":"2024-08-17T02:26:03.704094+0000","last_peered":"2024-08-17T02:26:03.704094+0000","last_clean":"2024-08-17T02:26:03.704094+0000","last_became_active":"2024-08-17T02:26:03.692908+0000","last_became_peered":"2024-08-17T02:26:03.692908+0000","last_unstale":"2024-08-17T02:26:03.704094+0000","last_undegraded":"2024-08-17T02:26:03.704094+0000","last_fullsized":"2024-08-17T02:26:03.704094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709161+0000","last_change":"2024-08-17T02:26:03.704953+0000","last_active":"2024-08-17T02:26:03.709161+0000","last_peered":"2024-08-17T02:26:03.709161+0000","last_clean":"2024-08-17T02:26:03.709161+0000","last_became_active":"2024-08-17T02:26:03.704774+0000","last_became_peered":"2024-08-17T02:26:03.704774+0000","last_unstale":"2024-08-17T02:26:03.709161+0000","last_undegraded":"2024-08-17T02:26:03.709161+0000","last_fullsized":"2024-08-17T02:26:03.709161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711737+0000","last_change":"2024-08-17T02:26:03.710637+0000","last_active":"2024-08-17T02:26:03.711737+0000","last_peered":"2024-08-17T02:26:03.711737+0000","last_clean":"2024-08-17T02:26:03.711737+0000","last_became_active":"2024-08-17T02:26:03.710268+0000","last_became_peered":"2024-08-17T02:26:03.710268+0000","last_unstale":"2024-08-17T02:26:03.711737+0000","last_undegraded":"2024-08-17T02:26:03.711737+0000","last_fullsized":"2024-08-17T02:26:03.711737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710647+0000","last_change":"2024-08-17T02:26:03.707884+0000","last_active":"2024-08-17T02:26:03.710647+0000","last_peered":"2024-08-17T02:26:03.710647+0000","last_clean":"2024-08-17T02:26:03.710647+0000","last_became_active":"2024-08-17T02:26:03.706445+0000","last_became_peered":"2024-08-17T02:26:03.706445+0000","last_unstale":"2024-08-17T02:26:03.710647+0000","last_undegraded":"2024-08-17T02:26:03.710647+0000","last_fullsized":"2024-08-17T02:26:03.710647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699705+0000","last_change":"2024-08-17T02:26:03.695921+0000","last_active":"2024-08-17T02:26:03.699705+0000","last_peered":"2024-08-17T02:26:03.699705+0000","last_clean":"2024-08-17T02:26:03.699705+0000","last_became_active":"2024-08-17T02:26:03.695608+0000","last_became_peered":"2024-08-17T02:26:03.695608+0000","last_unstale":"2024-08-17T02:26:03.699705+0000","last_undegraded":"2024-08-17T02:26:03.699705+0000","last_fullsized":"2024-08-17T02:26:03.699705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701377+0000","last_change":"2024-08-17T02:26:03.697117+0000","last_active":"2024-08-17T02:26:03.701377+0000","last_peered":"2024-08-17T02:26:03.701377+0000","last_clean":"2024-08-17T02:26:03.701377+0000","last_became_active":"2024-08-17T02:26:03.696545+0000","last_became_peered":"2024-08-17T02:26:03.696545+0000","last_unstale":"2024-08-17T02:26:03.701377+0000","last_undegraded":"2024-08-17T02:26:03.701377+0000","last_fullsized":"2024-08-17T02:26:03.701377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.698248+0000","last_change":"2024-08-17T02:26:03.692906+0000","last_active":"2024-08-17T02:26:03.698248+0000","last_peered":"2024-08-17T02:26:03.698248+0000","last_clean":"2024-08-17T02:26:03.698248+0000","last_became_active":"2024-08-17T02:26:03.690376+0000","last_became_peered":"2024-08-17T02:26:03.690376+0000","last_unstale":"2024-08-17T02:26:03.698248+0000","last_undegraded":"2024-08-17T02:26:03.698248+0000","last_fullsized":"2024-08-17T02:26:03.698248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708921+0000","last_change":"2024-08-17T02:26:02.683268+0000","last_active":"2024-08-17T02:26:03.708921+0000","last_peered":"2024-08-17T02:26:03.708921+0000","last_clean":"2024-08-17T02:26:03.708921+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.708921+0000","last_undegraded":"2024-08-17T02:26:03.708921+0000","last_fullsized":"2024-08-17T02:26:03.708921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700431+0000","last_change":"2024-08-17T02:26:03.696347+0000","last_active":"2024-08-17T02:26:03.700431+0000","last_peered":"2024-08-17T02:26:03.700431+0000","last_clean":"2024-08-17T02:26:03.700431+0000","last_became_active":"2024-08-17T02:26:03.696090+0000","last_became_peered":"2024-08-17T02:26:03.696090+0000","last_unstale":"2024-08-17T02:26:03.700431+0000","last_undegraded":"2024-08-17T02:26:03.700431+0000","last_fullsized":"2024-08-17T02:26:03.700431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710159+0000","last_change":"2024-08-17T02:26:02.692755+0000","last_active":"2024-08-17T02:26:03.710159+0000","last_peered":"2024-08-17T02:26:03.710159+0000","last_clean":"2024-08-17T02:26:03.710159+0000","last_became_active":"2024-08-17T02:26:02.692433+0000","last_became_peered":"2024-08-17T02:26:02.692433+0000","last_unstale":"2024-08-17T02:26:03.710159+0000","last_undegraded":"2024-08-17T02:26:03.710159+0000","last_fullsized":"2024-08-17T02:26:03.710159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.690965+0000","last_change":"2024-08-17T02:26:02.690367+0000","last_active":"2024-08-17T02:26:03.690965+0000","last_peered":"2024-08-17T02:26:03.690965+0000","last_clean":"2024-08-17T02:26:03.690965+0000","last_became_active":"2024-08-17T02:26:02.686604+0000","last_became_peered":"2024-08-17T02:26:02.686604+0000","last_unstale":"2024-08-17T02:26:03.690965+0000","last_undegraded":"2024-08-17T02:26:03.690965+0000","last_fullsized":"2024-08-17T02:26:03.690965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700829+0000","last_change":"2024-08-17T02:26:03.694153+0000","last_active":"2024-08-17T02:26:03.700829+0000","last_peered":"2024-08-17T02:26:03.700829+0000","last_clean":"2024-08-17T02:26:03.700829+0000","last_became_active":"2024-08-17T02:26:03.693219+0000","last_became_peered":"2024-08-17T02:26:03.693219+0000","last_unstale":"2024-08-17T02:26:03.700829+0000","last_undegraded":"2024-08-17T02:26:03.700829+0000","last_fullsized":"2024-08-17T02:26:03.700829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.685673+0000","last_change":"2024-08-17T02:26:02.699358+0000","last_active":"2024-08-17T02:26:03.685673+0000","last_peered":"2024-08-17T02:26:03.685673+0000","last_clean":"2024-08-17T02:26:03.685673+0000","last_became_active":"2024-08-17T02:26:02.699049+0000","last_became_peered":"2024-08-17T02:26:02.699049+0000","last_unstale":"2024-08-17T02:26:03.685673+0000","last_undegraded":"2024-08-17T02:26:03.685673+0000","last_fullsized":"2024-08-17T02:26:03.685673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702281+0000","last_change":"2024-08-17T02:26:03.696889+0000","last_active":"2024-08-17T02:26:03.702281+0000","last_peered":"2024-08-17T02:26:03.702281+0000","last_clean":"2024-08-17T02:26:03.702281+0000","last_became_active":"2024-08-17T02:26:03.696643+0000","last_became_peered":"2024-08-17T02:26:03.696643+0000","last_unstale":"2024-08-17T02:26:03.702281+0000","last_undegraded":"2024-08-17T02:26:03.702281+0000","last_fullsized":"2024-08-17T02:26:03.702281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.694183+0000","last_change":"2024-08-17T02:26:02.698402+0000","last_active":"2024-08-17T02:26:03.694183+0000","last_peered":"2024-08-17T02:26:03.694183+0000","last_clean":"2024-08-17T02:26:03.694183+0000","last_became_active":"2024-08-17T02:26:02.698127+0000","last_became_peered":"2024-08-17T02:26:02.698127+0000","last_unstale":"2024-08-17T02:26:03.694183+0000","last_undegraded":"2024-08-17T02:26:03.694183+0000","last_fullsized":"2024-08-17T02:26:03.694183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711040+0000","last_change":"2024-08-17T02:26:03.706523+0000","last_active":"2024-08-17T02:26:03.711040+0000","last_peered":"2024-08-17T02:26:03.711040+0000","last_clean":"2024-08-17T02:26:03.711040+0000","last_became_active":"2024-08-17T02:26:03.706259+0000","last_became_peered":"2024-08-17T02:26:03.706259+0000","last_unstale":"2024-08-17T02:26:03.711040+0000","last_undegraded":"2024-08-17T02:26:03.711040+0000","last_fullsized":"2024-08-17T02:26:03.711040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.682256+0000","last_change":"2024-08-17T02:26:02.697853+0000","last_active":"2024-08-17T02:26:03.682256+0000","last_peered":"2024-08-17T02:26:03.682256+0000","last_clean":"2024-08-17T02:26:03.682256+0000","last_became_active":"2024-08-17T02:26:02.697333+0000","last_became_peered":"2024-08-17T02:26:02.697333+0000","last_unstale":"2024-08-17T02:26:03.682256+0000","last_undegraded":"2024-08-17T02:26:03.682256+0000","last_fullsized":"2024-08-17T02:26:03.682256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700464+0000","last_change":"2024-08-17T02:26:03.697416+0000","last_active":"2024-08-17T02:26:03.700464+0000","last_peered":"2024-08-17T02:26:03.700464+0000","last_clean":"2024-08-17T02:26:03.700464+0000","last_became_active":"2024-08-17T02:26:03.697117+0000","last_became_peered":"2024-08-17T02:26:03.697117+0000","last_unstale":"2024-08-17T02:26:03.700464+0000","last_undegraded":"2024-08-17T02:26:03.700464+0000","last_fullsized":"2024-08-17T02:26:03.700464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704050+0000","last_change":"2024-08-17T02:26:02.698299+0000","last_active":"2024-08-17T02:26:03.704050+0000","last_peered":"2024-08-17T02:26:03.704050+0000","last_clean":"2024-08-17T02:26:03.704050+0000","last_became_active":"2024-08-17T02:26:02.698048+0000","last_became_peered":"2024-08-17T02:26:02.698048+0000","last_unstale":"2024-08-17T02:26:03.704050+0000","last_undegraded":"2024-08-17T02:26:03.704050+0000","last_fullsized":"2024-08-17T02:26:03.704050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713183+0000","last_change":"2024-08-17T02:26:03.711973+0000","last_active":"2024-08-17T02:26:03.713183+0000","last_peered":"2024-08-17T02:26:03.713183+0000","last_clean":"2024-08-17T02:26:03.713183+0000","last_became_active":"2024-08-17T02:26:03.709989+0000","last_became_peered":"2024-08-17T02:26:03.709989+0000","last_unstale":"2024-08-17T02:26:03.713183+0000","last_undegraded":"2024-08-17T02:26:03.713183+0000","last_fullsized":"2024-08-17T02:26:03.713183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.714929+0000","last_change":"2024-08-17T02:26:02.693614+0000","last_active":"2024-08-17T02:26:03.714929+0000","last_peered":"2024-08-17T02:26:03.714929+0000","last_clean":"2024-08-17T02:26:03.714929+0000","last_became_active":"2024-08-17T02:26:02.691439+0000","last_became_peered":"2024-08-17T02:26:02.691439+0000","last_unstale":"2024-08-17T02:26:03.714929+0000","last_undegraded":"2024-08-17T02:26:03.714929+0000","last_fullsized":"2024-08-17T02:26:03.714929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708522+0000","last_change":"2024-08-17T02:26:03.700840+0000","last_active":"2024-08-17T02:26:03.708522+0000","last_peered":"2024-08-17T02:26:03.708522+0000","last_clean":"2024-08-17T02:26:03.708522+0000","last_became_active":"2024-08-17T02:26:03.691916+0000","last_became_peered":"2024-08-17T02:26:03.691916+0000","last_unstale":"2024-08-17T02:26:03.708522+0000","last_undegraded":"2024-08-17T02:26:03.708522+0000","last_fullsized":"2024-08-17T02:26:03.708522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695917+0000","last_change":"2024-08-17T02:26:02.693440+0000","last_active":"2024-08-17T02:26:03.695917+0000","last_peered":"2024-08-17T02:26:03.695917+0000","last_clean":"2024-08-17T02:26:03.695917+0000","last_became_active":"2024-08-17T02:26:02.693121+0000","last_became_peered":"2024-08-17T02:26:02.693121+0000","last_unstale":"2024-08-17T02:26:03.695917+0000","last_undegraded":"2024-08-17T02:26:03.695917+0000","last_fullsized":"2024-08-17T02:26:03.695917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:11.874973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700196+0000","last_change":"2024-08-17T02:26:03.695504+0000","last_active":"2024-08-17T02:26:03.700196+0000","last_peered":"2024-08-17T02:26:03.700196+0000","last_clean":"2024-08-17T02:26:03.700196+0000","last_became_active":"2024-08-17T02:26:03.694472+0000","last_became_peered":"2024-08-17T02:26:03.694472+0000","last_unstale":"2024-08-17T02:26:03.700196+0000","last_undegraded":"2024-08-17T02:26:03.700196+0000","last_fullsized":"2024-08-17T02:26:03.700196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:16.565066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.684416+0000","last_change":"2024-08-17T02:26:02.698302+0000","last_active":"2024-08-17T02:26:03.684416+0000","last_peered":"2024-08-17T02:26:03.684416+0000","last_clean":"2024-08-17T02:26:03.684416+0000","last_became_active":"2024-08-17T02:26:02.698027+0000","last_became_peered":"2024-08-17T02:26:02.698027+0000","last_unstale":"2024-08-17T02:26:03.684416+0000","last_undegraded":"2024-08-17T02:26:03.684416+0000","last_fullsized":"2024-08-17T02:26:03.684416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709234+0000","last_change":"2024-08-17T02:26:03.703475+0000","last_active":"2024-08-17T02:26:03.709234+0000","last_peered":"2024-08-17T02:26:03.709234+0000","last_clean":"2024-08-17T02:26:03.709234+0000","last_became_active":"2024-08-17T02:26:03.701071+0000","last_became_peered":"2024-08-17T02:26:03.701071+0000","last_unstale":"2024-08-17T02:26:03.709234+0000","last_undegraded":"2024-08-17T02:26:03.709234+0000","last_fullsized":"2024-08-17T02:26:03.709234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.693250+0000","last_change":"2024-08-17T02:26:02.693306+0000","last_active":"2024-08-17T02:26:03.693250+0000","last_peered":"2024-08-17T02:26:03.693250+0000","last_clean":"2024-08-17T02:26:03.693250+0000","last_became_active":"2024-08-17T02:26:02.692943+0000","last_became_peered":"2024-08-17T02:26:02.692943+0000","last_unstale":"2024-08-17T02:26:03.693250+0000","last_undegraded":"2024-08-17T02:26:03.693250+0000","last_fullsized":"2024-08-17T02:26:03.693250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701357+0000","last_change":"2024-08-17T02:26:03.696903+0000","last_active":"2024-08-17T02:26:03.701357+0000","last_peered":"2024-08-17T02:26:03.701357+0000","last_clean":"2024-08-17T02:26:03.701357+0000","last_became_active":"2024-08-17T02:26:03.696184+0000","last_became_peered":"2024-08-17T02:26:03.696184+0000","last_unstale":"2024-08-17T02:26:03.701357+0000","last_undegraded":"2024-08-17T02:26:03.701357+0000","last_fullsized":"2024-08-17T02:26:03.701357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705429+0000","last_change":"2024-08-17T02:26:02.686536+0000","last_active":"2024-08-17T02:26:03.705429+0000","last_peered":"2024-08-17T02:26:03.705429+0000","last_clean":"2024-08-17T02:26:03.705429+0000","last_became_active":"2024-08-17T02:26:02.686234+0000","last_became_peered":"2024-08-17T02:26:02.686234+0000","last_unstale":"2024-08-17T02:26:03.705429+0000","last_undegraded":"2024-08-17T02:26:03.705429+0000","last_fullsized":"2024-08-17T02:26:03.705429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710752+0000","last_change":"2024-08-17T02:26:03.705371+0000","last_active":"2024-08-17T02:26:03.710752+0000","last_peered":"2024-08-17T02:26:03.710752+0000","last_clean":"2024-08-17T02:26:03.710752+0000","last_became_active":"2024-08-17T02:26:03.703153+0000","last_became_peered":"2024-08-17T02:26:03.703153+0000","last_unstale":"2024-08-17T02:26:03.710752+0000","last_undegraded":"2024-08-17T02:26:03.710752+0000","last_fullsized":"2024-08-17T02:26:03.710752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697690+0000","last_change":"2024-08-17T02:26:02.697624+0000","last_active":"2024-08-17T02:26:03.697690+0000","last_peered":"2024-08-17T02:26:03.697690+0000","last_clean":"2024-08-17T02:26:03.697690+0000","last_became_active":"2024-08-17T02:26:02.697417+0000","last_became_peered":"2024-08-17T02:26:02.697417+0000","last_unstale":"2024-08-17T02:26:03.697690+0000","last_undegraded":"2024-08-17T02:26:03.697690+0000","last_fullsized":"2024-08-17T02:26:03.697690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:09.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710177+0000","last_change":"2024-08-17T02:26:03.705614+0000","last_active":"2024-08-17T02:26:03.710177+0000","last_peered":"2024-08-17T02:26:03.710177+0000","last_clean":"2024-08-17T02:26:03.710177+0000","last_became_active":"2024-08-17T02:26:03.701211+0000","last_became_peered":"2024-08-17T02:26:03.701211+0000","last_unstale":"2024-08-17T02:26:03.710177+0000","last_undegraded":"2024-08-17T02:26:03.710177+0000","last_fullsized":"2024-08-17T02:26:03.710177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704863+0000","last_change":"2024-08-17T02:26:02.686432+0000","last_active":"2024-08-17T02:26:03.704863+0000","last_peered":"2024-08-17T02:26:03.704863+0000","last_clean":"2024-08-17T02:26:03.704863+0000","last_became_active":"2024-08-17T02:26:02.686122+0000","last_became_peered":"2024-08-17T02:26:02.686122+0000","last_unstale":"2024-08-17T02:26:03.704863+0000","last_undegraded":"2024-08-17T02:26:03.704863+0000","last_fullsized":"2024-08-17T02:26:03.704863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710286+0000","last_change":"2024-08-17T02:26:03.707361+0000","last_active":"2024-08-17T02:26:03.710286+0000","last_peered":"2024-08-17T02:26:03.710286+0000","last_clean":"2024-08-17T02:26:03.710286+0000","last_became_active":"2024-08-17T02:26:03.702988+0000","last_became_peered":"2024-08-17T02:26:03.702988+0000","last_unstale":"2024-08-17T02:26:03.710286+0000","last_undegraded":"2024-08-17T02:26:03.710286+0000","last_fullsized":"2024-08-17T02:26:03.710286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707330+0000","last_change":"2024-08-17T02:26:02.691873+0000","last_active":"2024-08-17T02:26:03.707330+0000","last_peered":"2024-08-17T02:26:03.707330+0000","last_clean":"2024-08-17T02:26:03.707330+0000","last_became_active":"2024-08-17T02:26:02.691585+0000","last_became_peered":"2024-08-17T02:26:02.691585+0000","last_unstale":"2024-08-17T02:26:03.707330+0000","last_undegraded":"2024-08-17T02:26:03.707330+0000","last_fullsized":"2024-08-17T02:26:03.707330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700359+0000","last_change":"2024-08-17T02:26:03.695043+0000","last_active":"2024-08-17T02:26:03.700359+0000","last_peered":"2024-08-17T02:26:03.700359+0000","last_clean":"2024-08-17T02:26:03.700359+0000","last_became_active":"2024-08-17T02:26:03.694187+0000","last_became_peered":"2024-08-17T02:26:03.694187+0000","last_unstale":"2024-08-17T02:26:03.700359+0000","last_undegraded":"2024-08-17T02:26:03.700359+0000","last_fullsized":"2024-08-17T02:26:03.700359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.673066+0000","last_change":"2024-08-17T02:26:02.698483+0000","last_active":"2024-08-17T02:26:03.673066+0000","last_peered":"2024-08-17T02:26:03.673066+0000","last_clean":"2024-08-17T02:26:03.673066+0000","last_became_active":"2024-08-17T02:26:02.698229+0000","last_became_peered":"2024-08-17T02:26:02.698229+0000","last_unstale":"2024-08-17T02:26:03.673066+0000","last_undegraded":"2024-08-17T02:26:03.673066+0000","last_fullsized":"2024-08-17T02:26:03.673066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710151+0000","last_change":"2024-08-17T02:26:03.703895+0000","last_active":"2024-08-17T02:26:03.710151+0000","last_peered":"2024-08-17T02:26:03.710151+0000","last_clean":"2024-08-17T02:26:03.710151+0000","last_became_active":"2024-08-17T02:26:03.703616+0000","last_became_peered":"2024-08-17T02:26:03.703616+0000","last_unstale":"2024-08-17T02:26:03.710151+0000","last_undegraded":"2024-08-17T02:26:03.710151+0000","last_fullsized":"2024-08-17T02:26:03.710151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:46.487161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674444+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:03.674444+0000","last_peered":"2024-08-17T02:26:03.674444+0000","last_clean":"2024-08-17T02:26:03.674444+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:03.674444+0000","last_undegraded":"2024-08-17T02:26:03.674444+0000","last_fullsized":"2024-08-17T02:26:03.674444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.678255+0000","last_change":"2024-08-17T02:26:02.691288+0000","last_active":"2024-08-17T02:26:03.678255+0000","last_peered":"2024-08-17T02:26:03.678255+0000","last_clean":"2024-08-17T02:26:03.678255+0000","last_became_active":"2024-08-17T02:26:02.691023+0000","last_became_peered":"2024-08-17T02:26:02.691023+0000","last_unstale":"2024-08-17T02:26:03.678255+0000","last_undegraded":"2024-08-17T02:26:03.678255+0000","last_fullsized":"2024-08-17T02:26:03.678255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707843+0000","last_change":"2024-08-17T02:26:03.705291+0000","last_active":"2024-08-17T02:26:03.707843+0000","last_peered":"2024-08-17T02:26:03.707843+0000","last_clean":"2024-08-17T02:26:03.707843+0000","last_became_active":"2024-08-17T02:26:03.704669+0000","last_became_peered":"2024-08-17T02:26:03.704669+0000","last_unstale":"2024-08-17T02:26:03.707843+0000","last_undegraded":"2024-08-17T02:26:03.707843+0000","last_fullsized":"2024-08-17T02:26:03.707843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674432+0000","last_change":"2024-08-17T02:26:02.683352+0000","last_active":"2024-08-17T02:26:03.674432+0000","last_peered":"2024-08-17T02:26:03.674432+0000","last_clean":"2024-08-17T02:26:03.674432+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.674432+0000","last_undegraded":"2024-08-17T02:26:03.674432+0000","last_fullsized":"2024-08-17T02:26:03.674432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700402+0000","last_change":"2024-08-17T02:26:03.695517+0000","last_active":"2024-08-17T02:26:03.700402+0000","last_peered":"2024-08-17T02:26:03.700402+0000","last_clean":"2024-08-17T02:26:03.700402+0000","last_became_active":"2024-08-17T02:26:03.694448+0000","last_became_peered":"2024-08-17T02:26:03.694448+0000","last_unstale":"2024-08-17T02:26:03.700402+0000","last_undegraded":"2024-08-17T02:26:03.700402+0000","last_fullsized":"2024-08-17T02:26:03.700402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674804+0000","last_change":"2024-08-17T02:26:02.681358+0000","last_active":"2024-08-17T02:26:03.674804+0000","last_peered":"2024-08-17T02:26:03.674804+0000","last_clean":"2024-08-17T02:26:03.674804+0000","last_became_active":"2024-08-17T02:26:02.681132+0000","last_became_peered":"2024-08-17T02:26:02.681132+0000","last_unstale":"2024-08-17T02:26:03.674804+0000","last_undegraded":"2024-08-17T02:26:03.674804+0000","last_fullsized":"2024-08-17T02:26:03.674804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.687643+0000","last_change":"2024-08-17T02:26:03.685671+0000","last_active":"2024-08-17T02:26:03.687643+0000","last_peered":"2024-08-17T02:26:03.687643+0000","last_clean":"2024-08-17T02:26:03.687643+0000","last_became_active":"2024-08-17T02:26:03.685342+0000","last_became_peered":"2024-08-17T02:26:03.685342+0000","last_unstale":"2024-08-17T02:26:03.687643+0000","last_undegraded":"2024-08-17T02:26:03.687643+0000","last_fullsized":"2024-08-17T02:26:03.687643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.684533+0000","last_change":"2024-08-17T02:26:02.697313+0000","last_active":"2024-08-17T02:26:03.684533+0000","last_peered":"2024-08-17T02:26:03.684533+0000","last_clean":"2024-08-17T02:26:03.684533+0000","last_became_active":"2024-08-17T02:26:02.693931+0000","last_became_peered":"2024-08-17T02:26:02.693931+0000","last_unstale":"2024-08-17T02:26:03.684533+0000","last_undegraded":"2024-08-17T02:26:03.684533+0000","last_fullsized":"2024-08-17T02:26:03.684533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704707+0000","last_change":"2024-08-17T02:26:03.698206+0000","last_active":"2024-08-17T02:26:03.704707+0000","last_peered":"2024-08-17T02:26:03.704707+0000","last_clean":"2024-08-17T02:26:03.704707+0000","last_became_active":"2024-08-17T02:26:03.696941+0000","last_became_peered":"2024-08-17T02:26:03.696941+0000","last_unstale":"2024-08-17T02:26:03.704707+0000","last_undegraded":"2024-08-17T02:26:03.704707+0000","last_fullsized":"2024-08-17T02:26:03.704707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:32.247498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674789+0000","last_change":"2024-08-17T02:26:02.689793+0000","last_active":"2024-08-17T02:26:03.674789+0000","last_peered":"2024-08-17T02:26:03.674789+0000","last_clean":"2024-08-17T02:26:03.674789+0000","last_became_active":"2024-08-17T02:26:02.689266+0000","last_became_peered":"2024-08-17T02:26:02.689266+0000","last_unstale":"2024-08-17T02:26:03.674789+0000","last_undegraded":"2024-08-17T02:26:03.674789+0000","last_fullsized":"2024-08-17T02:26:03.674789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700913+0000","last_change":"2024-08-17T02:26:03.696041+0000","last_active":"2024-08-17T02:26:03.700913+0000","last_peered":"2024-08-17T02:26:03.700913+0000","last_clean":"2024-08-17T02:26:03.700913+0000","last_became_active":"2024-08-17T02:26:03.695675+0000","last_became_peered":"2024-08-17T02:26:03.695675+0000","last_unstale":"2024-08-17T02:26:03.700913+0000","last_undegraded":"2024-08-17T02:26:03.700913+0000","last_fullsized":"2024-08-17T02:26:03.700913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.676108+0000","last_change":"2024-08-17T02:26:02.691075+0000","last_active":"2024-08-17T02:26:03.676108+0000","last_peered":"2024-08-17T02:26:03.676108+0000","last_clean":"2024-08-17T02:26:03.676108+0000","last_became_active":"2024-08-17T02:26:02.690601+0000","last_became_peered":"2024-08-17T02:26:02.690601+0000","last_unstale":"2024-08-17T02:26:03.676108+0000","last_undegraded":"2024-08-17T02:26:03.676108+0000","last_fullsized":"2024-08-17T02:26:03.676108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:15.556656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.687686+0000","last_change":"2024-08-17T02:26:03.686234+0000","last_active":"2024-08-17T02:26:03.687686+0000","last_peered":"2024-08-17T02:26:03.687686+0000","last_clean":"2024-08-17T02:26:03.687686+0000","last_became_active":"2024-08-17T02:26:03.685409+0000","last_became_peered":"2024-08-17T02:26:03.685409+0000","last_unstale":"2024-08-17T02:26:03.687686+0000","last_undegraded":"2024-08-17T02:26:03.687686+0000","last_fullsized":"2024-08-17T02:26:03.687686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:05.383303+0000","last_change":"2024-08-17T02:26:02.694328+0000","last_active":"2024-08-17T02:26:05.383303+0000","last_peered":"2024-08-17T02:26:05.383303+0000","last_clean":"2024-08-17T02:26:05.383303+0000","last_became_active":"2024-08-17T02:26:02.693978+0000","last_became_peered":"2024-08-17T02:26:02.693978+0000","last_unstale":"2024-08-17T02:26:05.383303+0000","last_undegraded":"2024-08-17T02:26:05.383303+0000","last_fullsized":"2024-08-17T02:26:05.383303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710044+0000","last_change":"2024-08-17T02:26:03.708726+0000","last_active":"2024-08-17T02:26:03.710044+0000","last_peered":"2024-08-17T02:26:03.710044+0000","last_clean":"2024-08-17T02:26:03.710044+0000","last_became_active":"2024-08-17T02:26:03.708552+0000","last_became_peered":"2024-08-17T02:26:03.708552+0000","last_unstale":"2024-08-17T02:26:03.710044+0000","last_undegraded":"2024-08-17T02:26:03.710044+0000","last_fullsized":"2024-08-17T02:26:03.710044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712327+0000","last_change":"2024-08-17T02:26:02.700098+0000","last_active":"2024-08-17T02:26:03.712327+0000","last_peered":"2024-08-17T02:26:03.712327+0000","last_clean":"2024-08-17T02:26:03.712327+0000","last_became_active":"2024-08-17T02:26:02.699846+0000","last_became_peered":"2024-08-17T02:26:02.699846+0000","last_unstale":"2024-08-17T02:26:03.712327+0000","last_undegraded":"2024-08-17T02:26:03.712327+0000","last_fullsized":"2024-08-17T02:26:03.712327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.681734+0000","last_change":"2024-08-17T02:26:03.678930+0000","last_active":"2024-08-17T02:26:03.681734+0000","last_peered":"2024-08-17T02:26:03.681734+0000","last_clean":"2024-08-17T02:26:03.681734+0000","last_became_active":"2024-08-17T02:26:03.678664+0000","last_became_peered":"2024-08-17T02:26:03.678664+0000","last_unstale":"2024-08-17T02:26:03.681734+0000","last_undegraded":"2024-08-17T02:26:03.681734+0000","last_fullsized":"2024-08-17T02:26:03.681734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674335+0000","last_change":"2024-08-17T02:26:02.691047+0000","last_active":"2024-08-17T02:26:03.674335+0000","last_peered":"2024-08-17T02:26:03.674335+0000","last_clean":"2024-08-17T02:26:03.674335+0000","last_became_active":"2024-08-17T02:26:02.690711+0000","last_became_peered":"2024-08-17T02:26:02.690711+0000","last_unstale":"2024-08-17T02:26:03.674335+0000","last_undegraded":"2024-08-17T02:26:03.674335+0000","last_fullsized":"2024-08-17T02:26:03.674335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:31.239087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702744+0000","last_change":"2024-08-17T02:26:03.696174+0000","last_active":"2024-08-17T02:26:03.702744+0000","last_peered":"2024-08-17T02:26:03.702744+0000","last_clean":"2024-08-17T02:26:03.702744+0000","last_became_active":"2024-08-17T02:26:03.695719+0000","last_became_peered":"2024-08-17T02:26:03.695719+0000","last_unstale":"2024-08-17T02:26:03.702744+0000","last_undegraded":"2024-08-17T02:26:03.702744+0000","last_fullsized":"2024-08-17T02:26:03.702744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:47.054753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674669+0000","last_change":"2024-08-17T02:26:02.683782+0000","last_active":"2024-08-17T02:26:03.674669+0000","last_peered":"2024-08-17T02:26:03.674669+0000","last_clean":"2024-08-17T02:26:03.674669+0000","last_became_active":"2024-08-17T02:26:02.681787+0000","last_became_peered":"2024-08-17T02:26:02.681787+0000","last_unstale":"2024-08-17T02:26:03.674669+0000","last_undegraded":"2024-08-17T02:26:03.674669+0000","last_fullsized":"2024-08-17T02:26:03.674669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700808+0000","last_change":"2024-08-17T02:26:03.692440+0000","last_active":"2024-08-17T02:26:03.700808+0000","last_peered":"2024-08-17T02:26:03.700808+0000","last_clean":"2024-08-17T02:26:03.700808+0000","last_became_active":"2024-08-17T02:26:03.691740+0000","last_became_peered":"2024-08-17T02:26:03.691740+0000","last_unstale":"2024-08-17T02:26:03.700808+0000","last_undegraded":"2024-08-17T02:26:03.700808+0000","last_fullsized":"2024-08-17T02:26:03.700808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674646+0000","last_change":"2024-08-17T02:26:02.682746+0000","last_active":"2024-08-17T02:26:03.674646+0000","last_peered":"2024-08-17T02:26:03.674646+0000","last_clean":"2024-08-17T02:26:03.674646+0000","last_became_active":"2024-08-17T02:26:02.677985+0000","last_became_peered":"2024-08-17T02:26:02.677985+0000","last_unstale":"2024-08-17T02:26:03.674646+0000","last_undegraded":"2024-08-17T02:26:03.674646+0000","last_fullsized":"2024-08-17T02:26:03.674646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701339+0000","last_change":"2024-08-17T02:26:03.694939+0000","last_active":"2024-08-17T02:26:03.701339+0000","last_peered":"2024-08-17T02:26:03.701339+0000","last_clean":"2024-08-17T02:26:03.701339+0000","last_became_active":"2024-08-17T02:26:03.694230+0000","last_became_peered":"2024-08-17T02:26:03.694230+0000","last_unstale":"2024-08-17T02:26:03.701339+0000","last_undegraded":"2024-08-17T02:26:03.701339+0000","last_fullsized":"2024-08-17T02:26:03.701339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713165+0000","last_change":"2024-08-17T02:26:02.695510+0000","last_active":"2024-08-17T02:26:03.713165+0000","last_peered":"2024-08-17T02:26:03.713165+0000","last_clean":"2024-08-17T02:26:03.713165+0000","last_became_active":"2024-08-17T02:26:02.695315+0000","last_became_peered":"2024-08-17T02:26:02.695315+0000","last_unstale":"2024-08-17T02:26:03.713165+0000","last_undegraded":"2024-08-17T02:26:03.713165+0000","last_fullsized":"2024-08-17T02:26:03.713165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710253+0000","last_change":"2024-08-17T02:26:03.704528+0000","last_active":"2024-08-17T02:26:03.710253+0000","last_peered":"2024-08-17T02:26:03.710253+0000","last_clean":"2024-08-17T02:26:03.710253+0000","last_became_active":"2024-08-17T02:26:03.693099+0000","last_became_peered":"2024-08-17T02:26:03.693099+0000","last_unstale":"2024-08-17T02:26:03.710253+0000","last_undegraded":"2024-08-17T02:26:03.710253+0000","last_fullsized":"2024-08-17T02:26:03.710253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707777+0000","last_change":"2024-08-17T02:26:03.699962+0000","last_active":"2024-08-17T02:26:03.707777+0000","last_peered":"2024-08-17T02:26:03.707777+0000","last_clean":"2024-08-17T02:26:03.707777+0000","last_became_active":"2024-08-17T02:26:03.699542+0000","last_became_peered":"2024-08-17T02:26:03.699542+0000","last_unstale":"2024-08-17T02:26:03.707777+0000","last_undegraded":"2024-08-17T02:26:03.707777+0000","last_fullsized":"2024-08-17T02:26:03.707777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713543+0000","last_change":"2024-08-17T02:26:02.699093+0000","last_active":"2024-08-17T02:26:03.713543+0000","last_peered":"2024-08-17T02:26:03.713543+0000","last_clean":"2024-08-17T02:26:03.713543+0000","last_became_active":"2024-08-17T02:26:02.698750+0000","last_became_peered":"2024-08-17T02:26:02.698750+0000","last_unstale":"2024-08-17T02:26:03.713543+0000","last_undegraded":"2024-08-17T02:26:03.713543+0000","last_fullsized":"2024-08-17T02:26:03.713543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700379+0000","last_change":"2024-08-17T02:26:03.695207+0000","last_active":"2024-08-17T02:26:03.700379+0000","last_peered":"2024-08-17T02:26:03.700379+0000","last_clean":"2024-08-17T02:26:03.700379+0000","last_became_active":"2024-08-17T02:26:03.694474+0000","last_became_peered":"2024-08-17T02:26:03.694474+0000","last_unstale":"2024-08-17T02:26:03.700379+0000","last_undegraded":"2024-08-17T02:26:03.700379+0000","last_fullsized":"2024-08-17T02:26:03.700379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712848+0000","last_change":"2024-08-17T02:26:02.694813+0000","last_active":"2024-08-17T02:26:03.712848+0000","last_peered":"2024-08-17T02:26:03.712848+0000","last_clean":"2024-08-17T02:26:03.712848+0000","last_became_active":"2024-08-17T02:26:02.694536+0000","last_became_peered":"2024-08-17T02:26:02.694536+0000","last_unstale":"2024-08-17T02:26:03.712848+0000","last_undegraded":"2024-08-17T02:26:03.712848+0000","last_fullsized":"2024-08-17T02:26:03.712848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700480+0000","last_change":"2024-08-17T02:26:03.697467+0000","last_active":"2024-08-17T02:26:03.700480+0000","last_peered":"2024-08-17T02:26:03.700480+0000","last_clean":"2024-08-17T02:26:03.700480+0000","last_became_active":"2024-08-17T02:26:03.697216+0000","last_became_peered":"2024-08-17T02:26:03.697216+0000","last_unstale":"2024-08-17T02:26:03.700480+0000","last_undegraded":"2024-08-17T02:26:03.700480+0000","last_fullsized":"2024-08-17T02:26:03.700480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711824+0000","last_change":"2024-08-17T02:26:02.690442+0000","last_active":"2024-08-17T02:26:03.711824+0000","last_peered":"2024-08-17T02:26:03.711824+0000","last_clean":"2024-08-17T02:26:03.711824+0000","last_became_active":"2024-08-17T02:26:02.689103+0000","last_became_peered":"2024-08-17T02:26:02.689103+0000","last_unstale":"2024-08-17T02:26:03.711824+0000","last_undegraded":"2024-08-17T02:26:03.711824+0000","last_fullsized":"2024-08-17T02:26:03.711824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710009+0000","last_change":"2024-08-17T02:26:03.705516+0000","last_active":"2024-08-17T02:26:03.710009+0000","last_peered":"2024-08-17T02:26:03.710009+0000","last_clean":"2024-08-17T02:26:03.710009+0000","last_became_active":"2024-08-17T02:26:03.705299+0000","last_became_peered":"2024-08-17T02:26:03.705299+0000","last_unstale":"2024-08-17T02:26:03.710009+0000","last_undegraded":"2024-08-17T02:26:03.710009+0000","last_fullsized":"2024-08-17T02:26:03.710009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710612+0000","last_change":"2024-08-17T02:26:02.698824+0000","last_active":"2024-08-17T02:26:03.710612+0000","last_peered":"2024-08-17T02:26:03.710612+0000","last_clean":"2024-08-17T02:26:03.710612+0000","last_became_active":"2024-08-17T02:26:02.698592+0000","last_became_peered":"2024-08-17T02:26:02.698592+0000","last_unstale":"2024-08-17T02:26:03.710612+0000","last_undegraded":"2024-08-17T02:26:03.710612+0000","last_fullsized":"2024-08-17T02:26:03.710612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1280000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9529999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2280000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.028}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:12.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:12.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.938+0000 7f6e34000640 1 Processor -- start 2024-08-17T02:26:12.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.938+0000 7f6e34000640 1 -- start start 2024-08-17T02:26:12.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.939+0000 7f6e34000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e2c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.939+0000 7f6e34000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0caa80 con 0x7f6e2c0b1440 2024-08-17T02:26:12.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.939+0000 7f6e34000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0c9e70 con 0x7f6e2c140580 2024-08-17T02:26:12.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.939+0000 7f6e34000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cb450 con 0x7f6e2c1401b0 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e32000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6e2c0b1440 0x7f6e2c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55982/0 (socket says 172.21.15.146:55982) 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e32000640 1 -- 172.21.15.146:0/2485736041 learned_addr learned my addr 172.21.15.146:0/2485736041 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e31600640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e2c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847763429 0 0) 0x7f6e2c0caa80 con 0x7f6e2c0b1440 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e140034e0 con 0x7f6e2c0b1440 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843915831 0 0) 0x7f6e2c0c9e70 con 0x7f6e2c140580 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c0caa80 con 0x7f6e2c140580 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4064755395 0 0) 0x7f6e140034e0 con 0x7f6e2c0b1440 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 msgr2=0x7f6e2c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e2c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 >> v1:172.21.15.150:6789/0 conn(0x7f6e2c140580 legacy=0x7f6e2c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0ca150 con 0x7f6e2c0b1440 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f6e240017f0 con 0x7f6e2c0b1440 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 >> v1:172.21.15.146:6789/0 conn(0x7f6e2c0b1440 legacy=0x7f6e2c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.940+0000 7f6e2be00640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14003b90 0x7f6e14003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e2be00640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e14004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e2be00640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e14004cc0 0x7f6e14005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cb450 con 0x7f6e14004cc0 2024-08-17T02:26:12.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1400bab0 con 0x7f6e14003b90 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1400bc70 con 0x7f6e2c1401b0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e14004cc0 0x7f6e14005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e31600640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14003b90 0x7f6e14003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e30c00640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e14004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 -- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 msgr2=0x7f6e14004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c1401b0 0x7f6e14004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 -- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14003b90 msgr2=0x7f6e14003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14003b90 0x7f6e14003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.941+0000 7f6e32000640 1 -- 172.21.15.146:0/2485736041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140034e0 con 0x7f6e14004cc0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.942+0000 7f6e32000640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e14004cc0 0x7f6e14005130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0cc940 tx=0x7f6e24002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486fd86f2c16adfc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.942+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240071c0 con 0x7f6e14004cc0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.942+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e24007340 con 0x7f6e14004cc0 2024-08-17T02:26:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.942+0000 7f6e2be00640 1 -- 172.21.15.146:0/2485736041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24007700 con 0x7f6e14004cc0 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 -- 172.21.15.146:0/2485736041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e14004cc0 msgr2=0x7f6e14005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 --2- 172.21.15.146:0/2485736041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e14004cc0 0x7f6e14005130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0cc940 tx=0x7f6e24002190 comp rx=0 tx=0).stop 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e32000640 1 -- 172.21.15.146:0/2485736041 reap_dead start 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 -- 172.21.15.146:0/2485736041 shutdown_connections 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 -- 172.21.15.146:0/2485736041 >> 172.21.15.146:0/2485736041 conn(0x7f6e2c0cb9b0 msgr2=0x7f6e2c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 -- 172.21.15.146:0/2485736041 shutdown_connections 2024-08-17T02:26:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.943+0000 7f6e34000640 1 -- 172.21.15.146:0/2485736041 wait complete. 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.944+0000 7f6e34000640 1 Processor -- start 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.944+0000 7f6e34000640 1 -- start start 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14004cc0 0x7f6e2c13e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c0c78c0 0x7f6e2c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a68b0 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a8680 con 0x7f6e14004cc0 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.945+0000 7f6e34000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a5ca0 con 0x7f6e2c0c78c0 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40536/0 (socket says 172.21.15.146:40536) 2024-08-17T02:26:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e31600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14004cc0 0x7f6e2c13e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 -- 172.21.15.146:0/1900083563 learned_addr learned my addr 172.21.15.146:0/1900083563 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e30c00640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c0c78c0 0x7f6e2c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 -- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c0c78c0 msgr2=0x7f6e2c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c0c78c0 0x7f6e2c0af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 -- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14004cc0 msgr2=0x7f6e2c13e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14004cc0 0x7f6e2c13e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 -- 172.21.15.146:0/1900083563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0a5f80 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e32000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400a8a0 tx=0x7f6e24034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.946+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2403f070 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.947+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240071c0 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.947+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c0a6260 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.947+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24004d70 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.947+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0a5950 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.948+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c0a6a60 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.948+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6e24038640 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.949+0000 7f6e28c00640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 0x7f6e0c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.949+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e240a23b0 con 0x7f6e2c0c7d10 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.949+0000 7f6e31600640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 0x7f6e0c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.950+0000 7f6e31600640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 0x7f6e0c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e20006e70 tx=0x7f6e200090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:12.953+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6e2c0a6a60 con 0x7f6e2c0c7d10 2024-08-17T02:26:13.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.125+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e2c0a66e0 con 0x7f6e0c065180 2024-08-17T02:26:13.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.132+0000 7f6e28c00640 1 -- 172.21.15.146:0/1900083563 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264506 (secure 0 0 0) 0x7f6e2c0a66e0 con 0x7f6e0c065180 2024-08-17T02:26:13.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:13.137 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.135+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 msgr2=0x7f6e0c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.135+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 0x7f6e0c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e20006e70 tx=0x7f6e200090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.135+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 msgr2=0x7f6e2c0af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.135+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400a8a0 tx=0x7f6e24034000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 shutdown_connections 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6e0c065180 0x7f6e0c067630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e2c0c7d10 0x7f6e2c0af950 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6e2c0c78c0 0x7f6e2c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 --2- 172.21.15.146:0/1900083563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e14004cc0 0x7f6e2c13e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 >> 172.21.15.146:0/1900083563 conn(0x7f6e2c0cb9b0 msgr2=0x7f6e2c06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 shutdown_connections 2024-08-17T02:26:13.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.136+0000 7f6e34000640 1 -- 172.21.15.146:0/1900083563 wait complete. 2024-08-17T02:26:13.151 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:26:12.325066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381688,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593032,"statfs":{"total":773094113280,"available":770655264768,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.658543"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710211+0000","last_change":"2024-08-17T02:26:03.706448+0000","last_active":"2024-08-17T02:26:03.710211+0000","last_peered":"2024-08-17T02:26:03.710211+0000","last_clean":"2024-08-17T02:26:03.710211+0000","last_became_active":"2024-08-17T02:26:03.691979+0000","last_became_peered":"2024-08-17T02:26:03.691979+0000","last_unstale":"2024-08-17T02:26:03.710211+0000","last_undegraded":"2024-08-17T02:26:03.710211+0000","last_fullsized":"2024-08-17T02:26:03.710211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686603+0000","last_change":"2024-08-17T02:26:03.683666+0000","last_active":"2024-08-17T02:26:03.686603+0000","last_peered":"2024-08-17T02:26:03.686603+0000","last_clean":"2024-08-17T02:26:03.686603+0000","last_became_active":"2024-08-17T02:26:03.683431+0000","last_became_peered":"2024-08-17T02:26:03.683431+0000","last_unstale":"2024-08-17T02:26:03.686603+0000","last_undegraded":"2024-08-17T02:26:03.686603+0000","last_fullsized":"2024-08-17T02:26:03.686603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.686845+0000","last_change":"2024-08-17T02:26:03.684515+0000","last_active":"2024-08-17T02:26:03.686845+0000","last_peered":"2024-08-17T02:26:03.686845+0000","last_clean":"2024-08-17T02:26:03.686845+0000","last_became_active":"2024-08-17T02:26:03.684225+0000","last_became_peered":"2024-08-17T02:26:03.684225+0000","last_unstale":"2024-08-17T02:26:03.686845+0000","last_undegraded":"2024-08-17T02:26:03.686845+0000","last_fullsized":"2024-08-17T02:26:03.686845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:48.325629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700394+0000","last_change":"2024-08-17T02:26:03.695442+0000","last_active":"2024-08-17T02:26:03.700394+0000","last_peered":"2024-08-17T02:26:03.700394+0000","last_clean":"2024-08-17T02:26:03.700394+0000","last_became_active":"2024-08-17T02:26:03.694771+0000","last_became_peered":"2024-08-17T02:26:03.694771+0000","last_unstale":"2024-08-17T02:26:03.700394+0000","last_undegraded":"2024-08-17T02:26:03.700394+0000","last_fullsized":"2024-08-17T02:26:03.700394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:06.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.706316+0000","last_change":"2024-08-17T02:26:03.691208+0000","last_active":"2024-08-17T02:26:03.706316+0000","last_peered":"2024-08-17T02:26:03.706316+0000","last_clean":"2024-08-17T02:26:03.706316+0000","last_became_active":"2024-08-17T02:26:03.690708+0000","last_became_peered":"2024-08-17T02:26:03.690708+0000","last_unstale":"2024-08-17T02:26:03.706316+0000","last_undegraded":"2024-08-17T02:26:03.706316+0000","last_fullsized":"2024-08-17T02:26:03.706316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700594+0000","last_change":"2024-08-17T02:26:03.696680+0000","last_active":"2024-08-17T02:26:03.700594+0000","last_peered":"2024-08-17T02:26:03.700594+0000","last_clean":"2024-08-17T02:26:03.700594+0000","last_became_active":"2024-08-17T02:26:03.696347+0000","last_became_peered":"2024-08-17T02:26:03.696347+0000","last_unstale":"2024-08-17T02:26:03.700594+0000","last_undegraded":"2024-08-17T02:26:03.700594+0000","last_fullsized":"2024-08-17T02:26:03.700594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705465+0000","last_change":"2024-08-17T02:26:03.690098+0000","last_active":"2024-08-17T02:26:03.705465+0000","last_peered":"2024-08-17T02:26:03.705465+0000","last_clean":"2024-08-17T02:26:03.705465+0000","last_became_active":"2024-08-17T02:26:03.688253+0000","last_became_peered":"2024-08-17T02:26:03.688253+0000","last_unstale":"2024-08-17T02:26:03.705465+0000","last_undegraded":"2024-08-17T02:26:03.705465+0000","last_fullsized":"2024-08-17T02:26:03.705465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707688+0000","last_change":"2024-08-17T02:26:03.704945+0000","last_active":"2024-08-17T02:26:03.707688+0000","last_peered":"2024-08-17T02:26:03.707688+0000","last_clean":"2024-08-17T02:26:03.707688+0000","last_became_active":"2024-08-17T02:26:03.704138+0000","last_became_peered":"2024-08-17T02:26:03.704138+0000","last_unstale":"2024-08-17T02:26:03.707688+0000","last_undegraded":"2024-08-17T02:26:03.707688+0000","last_fullsized":"2024-08-17T02:26:03.707688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710295+0000","last_change":"2024-08-17T02:26:03.707594+0000","last_active":"2024-08-17T02:26:03.710295+0000","last_peered":"2024-08-17T02:26:03.710295+0000","last_clean":"2024-08-17T02:26:03.710295+0000","last_became_active":"2024-08-17T02:26:03.707040+0000","last_became_peered":"2024-08-17T02:26:03.707040+0000","last_unstale":"2024-08-17T02:26:03.710295+0000","last_undegraded":"2024-08-17T02:26:03.710295+0000","last_fullsized":"2024-08-17T02:26:03.710295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.711882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710990+0000","last_change":"2024-08-17T02:26:03.699269+0000","last_active":"2024-08-17T02:26:03.710990+0000","last_peered":"2024-08-17T02:26:03.710990+0000","last_clean":"2024-08-17T02:26:03.710990+0000","last_became_active":"2024-08-17T02:26:03.698978+0000","last_became_peered":"2024-08-17T02:26:03.698978+0000","last_unstale":"2024-08-17T02:26:03.710990+0000","last_undegraded":"2024-08-17T02:26:03.710990+0000","last_fullsized":"2024-08-17T02:26:03.710990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709665+0000","last_change":"2024-08-17T02:26:03.699531+0000","last_active":"2024-08-17T02:26:03.709665+0000","last_peered":"2024-08-17T02:26:03.709665+0000","last_clean":"2024-08-17T02:26:03.709665+0000","last_became_active":"2024-08-17T02:26:03.699231+0000","last_became_peered":"2024-08-17T02:26:03.699231+0000","last_unstale":"2024-08-17T02:26:03.709665+0000","last_undegraded":"2024-08-17T02:26:03.709665+0000","last_fullsized":"2024-08-17T02:26:03.709665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705036+0000","last_change":"2024-08-17T02:26:03.699887+0000","last_active":"2024-08-17T02:26:03.705036+0000","last_peered":"2024-08-17T02:26:03.705036+0000","last_clean":"2024-08-17T02:26:03.705036+0000","last_became_active":"2024-08-17T02:26:03.699594+0000","last_became_peered":"2024-08-17T02:26:03.699594+0000","last_unstale":"2024-08-17T02:26:03.705036+0000","last_undegraded":"2024-08-17T02:26:03.705036+0000","last_fullsized":"2024-08-17T02:26:03.705036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:07.573229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708999+0000","last_change":"2024-08-17T02:26:03.701254+0000","last_active":"2024-08-17T02:26:03.708999+0000","last_peered":"2024-08-17T02:26:03.708999+0000","last_clean":"2024-08-17T02:26:03.708999+0000","last_became_active":"2024-08-17T02:26:03.700989+0000","last_became_peered":"2024-08-17T02:26:03.700989+0000","last_unstale":"2024-08-17T02:26:03.708999+0000","last_undegraded":"2024-08-17T02:26:03.708999+0000","last_fullsized":"2024-08-17T02:26:03.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.683122+0000","last_change":"2024-08-17T02:26:03.680779+0000","last_active":"2024-08-17T02:26:03.683122+0000","last_peered":"2024-08-17T02:26:03.683122+0000","last_clean":"2024-08-17T02:26:03.683122+0000","last_became_active":"2024-08-17T02:26:03.678795+0000","last_became_peered":"2024-08-17T02:26:03.678795+0000","last_unstale":"2024-08-17T02:26:03.683122+0000","last_undegraded":"2024-08-17T02:26:03.683122+0000","last_fullsized":"2024-08-17T02:26:03.683122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702298+0000","last_change":"2024-08-17T02:26:03.700633+0000","last_active":"2024-08-17T02:26:03.702298+0000","last_peered":"2024-08-17T02:26:03.702298+0000","last_clean":"2024-08-17T02:26:03.702298+0000","last_became_active":"2024-08-17T02:26:03.700302+0000","last_became_peered":"2024-08-17T02:26:03.700302+0000","last_unstale":"2024-08-17T02:26:03.702298+0000","last_undegraded":"2024-08-17T02:26:03.702298+0000","last_fullsized":"2024-08-17T02:26:03.702298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700498+0000","last_change":"2024-08-17T02:26:03.696556+0000","last_active":"2024-08-17T02:26:03.700498+0000","last_peered":"2024-08-17T02:26:03.700498+0000","last_clean":"2024-08-17T02:26:03.700498+0000","last_became_active":"2024-08-17T02:26:03.696283+0000","last_became_peered":"2024-08-17T02:26:03.696283+0000","last_unstale":"2024-08-17T02:26:03.700498+0000","last_undegraded":"2024-08-17T02:26:03.700498+0000","last_fullsized":"2024-08-17T02:26:03.700498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713422+0000","last_change":"2024-08-17T02:26:03.711711+0000","last_active":"2024-08-17T02:26:03.713422+0000","last_peered":"2024-08-17T02:26:03.713422+0000","last_clean":"2024-08-17T02:26:03.713422+0000","last_became_active":"2024-08-17T02:26:03.711488+0000","last_became_peered":"2024-08-17T02:26:03.711488+0000","last_unstale":"2024-08-17T02:26:03.713422+0000","last_undegraded":"2024-08-17T02:26:03.713422+0000","last_fullsized":"2024-08-17T02:26:03.713422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699741+0000","last_change":"2024-08-17T02:26:03.697674+0000","last_active":"2024-08-17T02:26:03.699741+0000","last_peered":"2024-08-17T02:26:03.699741+0000","last_clean":"2024-08-17T02:26:03.699741+0000","last_became_active":"2024-08-17T02:26:03.694701+0000","last_became_peered":"2024-08-17T02:26:03.694701+0000","last_unstale":"2024-08-17T02:26:03.699741+0000","last_undegraded":"2024-08-17T02:26:03.699741+0000","last_fullsized":"2024-08-17T02:26:03.699741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708484+0000","last_change":"2024-08-17T02:26:03.700361+0000","last_active":"2024-08-17T02:26:03.708484+0000","last_peered":"2024-08-17T02:26:03.708484+0000","last_clean":"2024-08-17T02:26:03.708484+0000","last_became_active":"2024-08-17T02:26:03.691498+0000","last_became_peered":"2024-08-17T02:26:03.691498+0000","last_unstale":"2024-08-17T02:26:03.708484+0000","last_undegraded":"2024-08-17T02:26:03.708484+0000","last_fullsized":"2024-08-17T02:26:03.708484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709665+0000","last_change":"2024-08-17T02:26:03.703171+0000","last_active":"2024-08-17T02:26:03.709665+0000","last_peered":"2024-08-17T02:26:03.709665+0000","last_clean":"2024-08-17T02:26:03.709665+0000","last_became_active":"2024-08-17T02:26:03.701780+0000","last_became_peered":"2024-08-17T02:26:03.701780+0000","last_unstale":"2024-08-17T02:26:03.709665+0000","last_undegraded":"2024-08-17T02:26:03.709665+0000","last_fullsized":"2024-08-17T02:26:03.709665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.689568+0000","last_change":"2024-08-17T02:26:03.684338+0000","last_active":"2024-08-17T02:26:03.689568+0000","last_peered":"2024-08-17T02:26:03.689568+0000","last_clean":"2024-08-17T02:26:03.689568+0000","last_became_active":"2024-08-17T02:26:03.683895+0000","last_became_peered":"2024-08-17T02:26:03.683895+0000","last_unstale":"2024-08-17T02:26:03.689568+0000","last_undegraded":"2024-08-17T02:26:03.689568+0000","last_fullsized":"2024-08-17T02:26:03.689568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710670+0000","last_change":"2024-08-17T02:26:03.708118+0000","last_active":"2024-08-17T02:26:03.710670+0000","last_peered":"2024-08-17T02:26:03.710670+0000","last_clean":"2024-08-17T02:26:03.710670+0000","last_became_active":"2024-08-17T02:26:03.707028+0000","last_became_peered":"2024-08-17T02:26:03.707028+0000","last_unstale":"2024-08-17T02:26:03.710670+0000","last_undegraded":"2024-08-17T02:26:03.710670+0000","last_fullsized":"2024-08-17T02:26:03.710670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701029+0000","last_change":"2024-08-17T02:26:03.698278+0000","last_active":"2024-08-17T02:26:03.701029+0000","last_peered":"2024-08-17T02:26:03.701029+0000","last_clean":"2024-08-17T02:26:03.701029+0000","last_became_active":"2024-08-17T02:26:03.698031+0000","last_became_peered":"2024-08-17T02:26:03.698031+0000","last_unstale":"2024-08-17T02:26:03.701029+0000","last_undegraded":"2024-08-17T02:26:03.701029+0000","last_fullsized":"2024-08-17T02:26:03.701029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700258+0000","last_change":"2024-08-17T02:26:03.694710+0000","last_active":"2024-08-17T02:26:03.700258+0000","last_peered":"2024-08-17T02:26:03.700258+0000","last_clean":"2024-08-17T02:26:03.700258+0000","last_became_active":"2024-08-17T02:26:03.693342+0000","last_became_peered":"2024-08-17T02:26:03.693342+0000","last_unstale":"2024-08-17T02:26:03.700258+0000","last_undegraded":"2024-08-17T02:26:03.700258+0000","last_fullsized":"2024-08-17T02:26:03.700258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701083+0000","last_change":"2024-08-17T02:26:03.698485+0000","last_active":"2024-08-17T02:26:03.701083+0000","last_peered":"2024-08-17T02:26:03.701083+0000","last_clean":"2024-08-17T02:26:03.701083+0000","last_became_active":"2024-08-17T02:26:03.698183+0000","last_became_peered":"2024-08-17T02:26:03.698183+0000","last_unstale":"2024-08-17T02:26:03.701083+0000","last_undegraded":"2024-08-17T02:26:03.701083+0000","last_fullsized":"2024-08-17T02:26:03.701083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713035+0000","last_change":"2024-08-17T02:26:03.707593+0000","last_active":"2024-08-17T02:26:03.713035+0000","last_peered":"2024-08-17T02:26:03.713035+0000","last_clean":"2024-08-17T02:26:03.713035+0000","last_became_active":"2024-08-17T02:26:03.707341+0000","last_became_peered":"2024-08-17T02:26:03.707341+0000","last_unstale":"2024-08-17T02:26:03.713035+0000","last_undegraded":"2024-08-17T02:26:03.713035+0000","last_fullsized":"2024-08-17T02:26:03.713035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704094+0000","last_change":"2024-08-17T02:26:03.693165+0000","last_active":"2024-08-17T02:26:03.704094+0000","last_peered":"2024-08-17T02:26:03.704094+0000","last_clean":"2024-08-17T02:26:03.704094+0000","last_became_active":"2024-08-17T02:26:03.692908+0000","last_became_peered":"2024-08-17T02:26:03.692908+0000","last_unstale":"2024-08-17T02:26:03.704094+0000","last_undegraded":"2024-08-17T02:26:03.704094+0000","last_fullsized":"2024-08-17T02:26:03.704094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709161+0000","last_change":"2024-08-17T02:26:03.704953+0000","last_active":"2024-08-17T02:26:03.709161+0000","last_peered":"2024-08-17T02:26:03.709161+0000","last_clean":"2024-08-17T02:26:03.709161+0000","last_became_active":"2024-08-17T02:26:03.704774+0000","last_became_peered":"2024-08-17T02:26:03.704774+0000","last_unstale":"2024-08-17T02:26:03.709161+0000","last_undegraded":"2024-08-17T02:26:03.709161+0000","last_fullsized":"2024-08-17T02:26:03.709161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:11.969619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711737+0000","last_change":"2024-08-17T02:26:03.710637+0000","last_active":"2024-08-17T02:26:03.711737+0000","last_peered":"2024-08-17T02:26:03.711737+0000","last_clean":"2024-08-17T02:26:03.711737+0000","last_became_active":"2024-08-17T02:26:03.710268+0000","last_became_peered":"2024-08-17T02:26:03.710268+0000","last_unstale":"2024-08-17T02:26:03.711737+0000","last_undegraded":"2024-08-17T02:26:03.711737+0000","last_fullsized":"2024-08-17T02:26:03.711737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710647+0000","last_change":"2024-08-17T02:26:03.707884+0000","last_active":"2024-08-17T02:26:03.710647+0000","last_peered":"2024-08-17T02:26:03.710647+0000","last_clean":"2024-08-17T02:26:03.710647+0000","last_became_active":"2024-08-17T02:26:03.706445+0000","last_became_peered":"2024-08-17T02:26:03.706445+0000","last_unstale":"2024-08-17T02:26:03.710647+0000","last_undegraded":"2024-08-17T02:26:03.710647+0000","last_fullsized":"2024-08-17T02:26:03.710647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.699705+0000","last_change":"2024-08-17T02:26:03.695921+0000","last_active":"2024-08-17T02:26:03.699705+0000","last_peered":"2024-08-17T02:26:03.699705+0000","last_clean":"2024-08-17T02:26:03.699705+0000","last_became_active":"2024-08-17T02:26:03.695608+0000","last_became_peered":"2024-08-17T02:26:03.695608+0000","last_unstale":"2024-08-17T02:26:03.699705+0000","last_undegraded":"2024-08-17T02:26:03.699705+0000","last_fullsized":"2024-08-17T02:26:03.699705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701377+0000","last_change":"2024-08-17T02:26:03.697117+0000","last_active":"2024-08-17T02:26:03.701377+0000","last_peered":"2024-08-17T02:26:03.701377+0000","last_clean":"2024-08-17T02:26:03.701377+0000","last_became_active":"2024-08-17T02:26:03.696545+0000","last_became_peered":"2024-08-17T02:26:03.696545+0000","last_unstale":"2024-08-17T02:26:03.701377+0000","last_undegraded":"2024-08-17T02:26:03.701377+0000","last_fullsized":"2024-08-17T02:26:03.701377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.698248+0000","last_change":"2024-08-17T02:26:03.692906+0000","last_active":"2024-08-17T02:26:03.698248+0000","last_peered":"2024-08-17T02:26:03.698248+0000","last_clean":"2024-08-17T02:26:03.698248+0000","last_became_active":"2024-08-17T02:26:03.690376+0000","last_became_peered":"2024-08-17T02:26:03.690376+0000","last_unstale":"2024-08-17T02:26:03.698248+0000","last_undegraded":"2024-08-17T02:26:03.698248+0000","last_fullsized":"2024-08-17T02:26:03.698248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:17.193456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708921+0000","last_change":"2024-08-17T02:26:02.683268+0000","last_active":"2024-08-17T02:26:03.708921+0000","last_peered":"2024-08-17T02:26:03.708921+0000","last_clean":"2024-08-17T02:26:03.708921+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.708921+0000","last_undegraded":"2024-08-17T02:26:03.708921+0000","last_fullsized":"2024-08-17T02:26:03.708921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700431+0000","last_change":"2024-08-17T02:26:03.696347+0000","last_active":"2024-08-17T02:26:03.700431+0000","last_peered":"2024-08-17T02:26:03.700431+0000","last_clean":"2024-08-17T02:26:03.700431+0000","last_became_active":"2024-08-17T02:26:03.696090+0000","last_became_peered":"2024-08-17T02:26:03.696090+0000","last_unstale":"2024-08-17T02:26:03.700431+0000","last_undegraded":"2024-08-17T02:26:03.700431+0000","last_fullsized":"2024-08-17T02:26:03.700431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710159+0000","last_change":"2024-08-17T02:26:02.692755+0000","last_active":"2024-08-17T02:26:03.710159+0000","last_peered":"2024-08-17T02:26:03.710159+0000","last_clean":"2024-08-17T02:26:03.710159+0000","last_became_active":"2024-08-17T02:26:02.692433+0000","last_became_peered":"2024-08-17T02:26:02.692433+0000","last_unstale":"2024-08-17T02:26:03.710159+0000","last_undegraded":"2024-08-17T02:26:03.710159+0000","last_fullsized":"2024-08-17T02:26:03.710159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.690965+0000","last_change":"2024-08-17T02:26:02.690367+0000","last_active":"2024-08-17T02:26:03.690965+0000","last_peered":"2024-08-17T02:26:03.690965+0000","last_clean":"2024-08-17T02:26:03.690965+0000","last_became_active":"2024-08-17T02:26:02.686604+0000","last_became_peered":"2024-08-17T02:26:02.686604+0000","last_unstale":"2024-08-17T02:26:03.690965+0000","last_undegraded":"2024-08-17T02:26:03.690965+0000","last_fullsized":"2024-08-17T02:26:03.690965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700829+0000","last_change":"2024-08-17T02:26:03.694153+0000","last_active":"2024-08-17T02:26:03.700829+0000","last_peered":"2024-08-17T02:26:03.700829+0000","last_clean":"2024-08-17T02:26:03.700829+0000","last_became_active":"2024-08-17T02:26:03.693219+0000","last_became_peered":"2024-08-17T02:26:03.693219+0000","last_unstale":"2024-08-17T02:26:03.700829+0000","last_undegraded":"2024-08-17T02:26:03.700829+0000","last_fullsized":"2024-08-17T02:26:03.700829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.685673+0000","last_change":"2024-08-17T02:26:02.699358+0000","last_active":"2024-08-17T02:26:03.685673+0000","last_peered":"2024-08-17T02:26:03.685673+0000","last_clean":"2024-08-17T02:26:03.685673+0000","last_became_active":"2024-08-17T02:26:02.699049+0000","last_became_peered":"2024-08-17T02:26:02.699049+0000","last_unstale":"2024-08-17T02:26:03.685673+0000","last_undegraded":"2024-08-17T02:26:03.685673+0000","last_fullsized":"2024-08-17T02:26:03.685673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702281+0000","last_change":"2024-08-17T02:26:03.696889+0000","last_active":"2024-08-17T02:26:03.702281+0000","last_peered":"2024-08-17T02:26:03.702281+0000","last_clean":"2024-08-17T02:26:03.702281+0000","last_became_active":"2024-08-17T02:26:03.696643+0000","last_became_peered":"2024-08-17T02:26:03.696643+0000","last_unstale":"2024-08-17T02:26:03.702281+0000","last_undegraded":"2024-08-17T02:26:03.702281+0000","last_fullsized":"2024-08-17T02:26:03.702281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.694183+0000","last_change":"2024-08-17T02:26:02.698402+0000","last_active":"2024-08-17T02:26:03.694183+0000","last_peered":"2024-08-17T02:26:03.694183+0000","last_clean":"2024-08-17T02:26:03.694183+0000","last_became_active":"2024-08-17T02:26:02.698127+0000","last_became_peered":"2024-08-17T02:26:02.698127+0000","last_unstale":"2024-08-17T02:26:03.694183+0000","last_undegraded":"2024-08-17T02:26:03.694183+0000","last_fullsized":"2024-08-17T02:26:03.694183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711040+0000","last_change":"2024-08-17T02:26:03.706523+0000","last_active":"2024-08-17T02:26:03.711040+0000","last_peered":"2024-08-17T02:26:03.711040+0000","last_clean":"2024-08-17T02:26:03.711040+0000","last_became_active":"2024-08-17T02:26:03.706259+0000","last_became_peered":"2024-08-17T02:26:03.706259+0000","last_unstale":"2024-08-17T02:26:03.711040+0000","last_undegraded":"2024-08-17T02:26:03.711040+0000","last_fullsized":"2024-08-17T02:26:03.711040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:22:19.402330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.682256+0000","last_change":"2024-08-17T02:26:02.697853+0000","last_active":"2024-08-17T02:26:03.682256+0000","last_peered":"2024-08-17T02:26:03.682256+0000","last_clean":"2024-08-17T02:26:03.682256+0000","last_became_active":"2024-08-17T02:26:02.697333+0000","last_became_peered":"2024-08-17T02:26:02.697333+0000","last_unstale":"2024-08-17T02:26:03.682256+0000","last_undegraded":"2024-08-17T02:26:03.682256+0000","last_fullsized":"2024-08-17T02:26:03.682256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700464+0000","last_change":"2024-08-17T02:26:03.697416+0000","last_active":"2024-08-17T02:26:03.700464+0000","last_peered":"2024-08-17T02:26:03.700464+0000","last_clean":"2024-08-17T02:26:03.700464+0000","last_became_active":"2024-08-17T02:26:03.697117+0000","last_became_peered":"2024-08-17T02:26:03.697117+0000","last_unstale":"2024-08-17T02:26:03.700464+0000","last_undegraded":"2024-08-17T02:26:03.700464+0000","last_fullsized":"2024-08-17T02:26:03.700464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704050+0000","last_change":"2024-08-17T02:26:02.698299+0000","last_active":"2024-08-17T02:26:03.704050+0000","last_peered":"2024-08-17T02:26:03.704050+0000","last_clean":"2024-08-17T02:26:03.704050+0000","last_became_active":"2024-08-17T02:26:02.698048+0000","last_became_peered":"2024-08-17T02:26:02.698048+0000","last_unstale":"2024-08-17T02:26:03.704050+0000","last_undegraded":"2024-08-17T02:26:03.704050+0000","last_fullsized":"2024-08-17T02:26:03.704050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713183+0000","last_change":"2024-08-17T02:26:03.711973+0000","last_active":"2024-08-17T02:26:03.713183+0000","last_peered":"2024-08-17T02:26:03.713183+0000","last_clean":"2024-08-17T02:26:03.713183+0000","last_became_active":"2024-08-17T02:26:03.709989+0000","last_became_peered":"2024-08-17T02:26:03.709989+0000","last_unstale":"2024-08-17T02:26:03.713183+0000","last_undegraded":"2024-08-17T02:26:03.713183+0000","last_fullsized":"2024-08-17T02:26:03.713183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:03.008106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.714929+0000","last_change":"2024-08-17T02:26:02.693614+0000","last_active":"2024-08-17T02:26:03.714929+0000","last_peered":"2024-08-17T02:26:03.714929+0000","last_clean":"2024-08-17T02:26:03.714929+0000","last_became_active":"2024-08-17T02:26:02.691439+0000","last_became_peered":"2024-08-17T02:26:02.691439+0000","last_unstale":"2024-08-17T02:26:03.714929+0000","last_undegraded":"2024-08-17T02:26:03.714929+0000","last_fullsized":"2024-08-17T02:26:03.714929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.708522+0000","last_change":"2024-08-17T02:26:03.700840+0000","last_active":"2024-08-17T02:26:03.708522+0000","last_peered":"2024-08-17T02:26:03.708522+0000","last_clean":"2024-08-17T02:26:03.708522+0000","last_became_active":"2024-08-17T02:26:03.691916+0000","last_became_peered":"2024-08-17T02:26:03.691916+0000","last_unstale":"2024-08-17T02:26:03.708522+0000","last_undegraded":"2024-08-17T02:26:03.708522+0000","last_fullsized":"2024-08-17T02:26:03.708522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.695917+0000","last_change":"2024-08-17T02:26:02.693440+0000","last_active":"2024-08-17T02:26:03.695917+0000","last_peered":"2024-08-17T02:26:03.695917+0000","last_clean":"2024-08-17T02:26:03.695917+0000","last_became_active":"2024-08-17T02:26:02.693121+0000","last_became_peered":"2024-08-17T02:26:02.693121+0000","last_unstale":"2024-08-17T02:26:03.695917+0000","last_undegraded":"2024-08-17T02:26:03.695917+0000","last_fullsized":"2024-08-17T02:26:03.695917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:11.874973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700196+0000","last_change":"2024-08-17T02:26:03.695504+0000","last_active":"2024-08-17T02:26:03.700196+0000","last_peered":"2024-08-17T02:26:03.700196+0000","last_clean":"2024-08-17T02:26:03.700196+0000","last_became_active":"2024-08-17T02:26:03.694472+0000","last_became_peered":"2024-08-17T02:26:03.694472+0000","last_unstale":"2024-08-17T02:26:03.700196+0000","last_undegraded":"2024-08-17T02:26:03.700196+0000","last_fullsized":"2024-08-17T02:26:03.700196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:16.565066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.684416+0000","last_change":"2024-08-17T02:26:02.698302+0000","last_active":"2024-08-17T02:26:03.684416+0000","last_peered":"2024-08-17T02:26:03.684416+0000","last_clean":"2024-08-17T02:26:03.684416+0000","last_became_active":"2024-08-17T02:26:02.698027+0000","last_became_peered":"2024-08-17T02:26:02.698027+0000","last_unstale":"2024-08-17T02:26:03.684416+0000","last_undegraded":"2024-08-17T02:26:03.684416+0000","last_fullsized":"2024-08-17T02:26:03.684416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.709234+0000","last_change":"2024-08-17T02:26:03.703475+0000","last_active":"2024-08-17T02:26:03.709234+0000","last_peered":"2024-08-17T02:26:03.709234+0000","last_clean":"2024-08-17T02:26:03.709234+0000","last_became_active":"2024-08-17T02:26:03.701071+0000","last_became_peered":"2024-08-17T02:26:03.701071+0000","last_unstale":"2024-08-17T02:26:03.709234+0000","last_undegraded":"2024-08-17T02:26:03.709234+0000","last_fullsized":"2024-08-17T02:26:03.709234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:28.127884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.693250+0000","last_change":"2024-08-17T02:26:02.693306+0000","last_active":"2024-08-17T02:26:03.693250+0000","last_peered":"2024-08-17T02:26:03.693250+0000","last_clean":"2024-08-17T02:26:03.693250+0000","last_became_active":"2024-08-17T02:26:02.692943+0000","last_became_peered":"2024-08-17T02:26:02.692943+0000","last_unstale":"2024-08-17T02:26:03.693250+0000","last_undegraded":"2024-08-17T02:26:03.693250+0000","last_fullsized":"2024-08-17T02:26:03.693250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701357+0000","last_change":"2024-08-17T02:26:03.696903+0000","last_active":"2024-08-17T02:26:03.701357+0000","last_peered":"2024-08-17T02:26:03.701357+0000","last_clean":"2024-08-17T02:26:03.701357+0000","last_became_active":"2024-08-17T02:26:03.696184+0000","last_became_peered":"2024-08-17T02:26:03.696184+0000","last_unstale":"2024-08-17T02:26:03.701357+0000","last_undegraded":"2024-08-17T02:26:03.701357+0000","last_fullsized":"2024-08-17T02:26:03.701357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.705429+0000","last_change":"2024-08-17T02:26:02.686536+0000","last_active":"2024-08-17T02:26:03.705429+0000","last_peered":"2024-08-17T02:26:03.705429+0000","last_clean":"2024-08-17T02:26:03.705429+0000","last_became_active":"2024-08-17T02:26:02.686234+0000","last_became_peered":"2024-08-17T02:26:02.686234+0000","last_unstale":"2024-08-17T02:26:03.705429+0000","last_undegraded":"2024-08-17T02:26:03.705429+0000","last_fullsized":"2024-08-17T02:26:03.705429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710752+0000","last_change":"2024-08-17T02:26:03.705371+0000","last_active":"2024-08-17T02:26:03.710752+0000","last_peered":"2024-08-17T02:26:03.710752+0000","last_clean":"2024-08-17T02:26:03.710752+0000","last_became_active":"2024-08-17T02:26:03.703153+0000","last_became_peered":"2024-08-17T02:26:03.703153+0000","last_unstale":"2024-08-17T02:26:03.710752+0000","last_undegraded":"2024-08-17T02:26:03.710752+0000","last_fullsized":"2024-08-17T02:26:03.710752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:26:46.391623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.697690+0000","last_change":"2024-08-17T02:26:02.697624+0000","last_active":"2024-08-17T02:26:03.697690+0000","last_peered":"2024-08-17T02:26:03.697690+0000","last_clean":"2024-08-17T02:26:03.697690+0000","last_became_active":"2024-08-17T02:26:02.697417+0000","last_became_peered":"2024-08-17T02:26:02.697417+0000","last_unstale":"2024-08-17T02:26:03.697690+0000","last_undegraded":"2024-08-17T02:26:03.697690+0000","last_fullsized":"2024-08-17T02:26:03.697690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:09.284230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710177+0000","last_change":"2024-08-17T02:26:03.705614+0000","last_active":"2024-08-17T02:26:03.710177+0000","last_peered":"2024-08-17T02:26:03.710177+0000","last_clean":"2024-08-17T02:26:03.710177+0000","last_became_active":"2024-08-17T02:26:03.701211+0000","last_became_peered":"2024-08-17T02:26:03.701211+0000","last_unstale":"2024-08-17T02:26:03.710177+0000","last_undegraded":"2024-08-17T02:26:03.710177+0000","last_fullsized":"2024-08-17T02:26:03.710177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:51.989325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704863+0000","last_change":"2024-08-17T02:26:02.686432+0000","last_active":"2024-08-17T02:26:03.704863+0000","last_peered":"2024-08-17T02:26:03.704863+0000","last_clean":"2024-08-17T02:26:03.704863+0000","last_became_active":"2024-08-17T02:26:02.686122+0000","last_became_peered":"2024-08-17T02:26:02.686122+0000","last_unstale":"2024-08-17T02:26:03.704863+0000","last_undegraded":"2024-08-17T02:26:03.704863+0000","last_fullsized":"2024-08-17T02:26:03.704863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710286+0000","last_change":"2024-08-17T02:26:03.707361+0000","last_active":"2024-08-17T02:26:03.710286+0000","last_peered":"2024-08-17T02:26:03.710286+0000","last_clean":"2024-08-17T02:26:03.710286+0000","last_became_active":"2024-08-17T02:26:03.702988+0000","last_became_peered":"2024-08-17T02:26:03.702988+0000","last_unstale":"2024-08-17T02:26:03.710286+0000","last_undegraded":"2024-08-17T02:26:03.710286+0000","last_fullsized":"2024-08-17T02:26:03.710286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:59:29.627817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707330+0000","last_change":"2024-08-17T02:26:02.691873+0000","last_active":"2024-08-17T02:26:03.707330+0000","last_peered":"2024-08-17T02:26:03.707330+0000","last_clean":"2024-08-17T02:26:03.707330+0000","last_became_active":"2024-08-17T02:26:02.691585+0000","last_became_peered":"2024-08-17T02:26:02.691585+0000","last_unstale":"2024-08-17T02:26:03.707330+0000","last_undegraded":"2024-08-17T02:26:03.707330+0000","last_fullsized":"2024-08-17T02:26:03.707330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700359+0000","last_change":"2024-08-17T02:26:03.695043+0000","last_active":"2024-08-17T02:26:03.700359+0000","last_peered":"2024-08-17T02:26:03.700359+0000","last_clean":"2024-08-17T02:26:03.700359+0000","last_became_active":"2024-08-17T02:26:03.694187+0000","last_became_peered":"2024-08-17T02:26:03.694187+0000","last_unstale":"2024-08-17T02:26:03.700359+0000","last_undegraded":"2024-08-17T02:26:03.700359+0000","last_fullsized":"2024-08-17T02:26:03.700359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.673066+0000","last_change":"2024-08-17T02:26:02.698483+0000","last_active":"2024-08-17T02:26:03.673066+0000","last_peered":"2024-08-17T02:26:03.673066+0000","last_clean":"2024-08-17T02:26:03.673066+0000","last_became_active":"2024-08-17T02:26:02.698229+0000","last_became_peered":"2024-08-17T02:26:02.698229+0000","last_unstale":"2024-08-17T02:26:03.673066+0000","last_undegraded":"2024-08-17T02:26:03.673066+0000","last_fullsized":"2024-08-17T02:26:03.673066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:41:21.917820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710151+0000","last_change":"2024-08-17T02:26:03.703895+0000","last_active":"2024-08-17T02:26:03.710151+0000","last_peered":"2024-08-17T02:26:03.710151+0000","last_clean":"2024-08-17T02:26:03.710151+0000","last_became_active":"2024-08-17T02:26:03.703616+0000","last_became_peered":"2024-08-17T02:26:03.703616+0000","last_unstale":"2024-08-17T02:26:03.710151+0000","last_undegraded":"2024-08-17T02:26:03.710151+0000","last_fullsized":"2024-08-17T02:26:03.710151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:32:46.487161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674444+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:03.674444+0000","last_peered":"2024-08-17T02:26:03.674444+0000","last_clean":"2024-08-17T02:26:03.674444+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:03.674444+0000","last_undegraded":"2024-08-17T02:26:03.674444+0000","last_fullsized":"2024-08-17T02:26:03.674444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.678255+0000","last_change":"2024-08-17T02:26:02.691288+0000","last_active":"2024-08-17T02:26:03.678255+0000","last_peered":"2024-08-17T02:26:03.678255+0000","last_clean":"2024-08-17T02:26:03.678255+0000","last_became_active":"2024-08-17T02:26:02.691023+0000","last_became_peered":"2024-08-17T02:26:02.691023+0000","last_unstale":"2024-08-17T02:26:03.678255+0000","last_undegraded":"2024-08-17T02:26:03.678255+0000","last_fullsized":"2024-08-17T02:26:03.678255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707843+0000","last_change":"2024-08-17T02:26:03.705291+0000","last_active":"2024-08-17T02:26:03.707843+0000","last_peered":"2024-08-17T02:26:03.707843+0000","last_clean":"2024-08-17T02:26:03.707843+0000","last_became_active":"2024-08-17T02:26:03.704669+0000","last_became_peered":"2024-08-17T02:26:03.704669+0000","last_unstale":"2024-08-17T02:26:03.707843+0000","last_undegraded":"2024-08-17T02:26:03.707843+0000","last_fullsized":"2024-08-17T02:26:03.707843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:00:31.727869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674432+0000","last_change":"2024-08-17T02:26:02.683352+0000","last_active":"2024-08-17T02:26:03.674432+0000","last_peered":"2024-08-17T02:26:03.674432+0000","last_clean":"2024-08-17T02:26:03.674432+0000","last_became_active":"2024-08-17T02:26:02.682961+0000","last_became_peered":"2024-08-17T02:26:02.682961+0000","last_unstale":"2024-08-17T02:26:03.674432+0000","last_undegraded":"2024-08-17T02:26:03.674432+0000","last_fullsized":"2024-08-17T02:26:03.674432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700402+0000","last_change":"2024-08-17T02:26:03.695517+0000","last_active":"2024-08-17T02:26:03.700402+0000","last_peered":"2024-08-17T02:26:03.700402+0000","last_clean":"2024-08-17T02:26:03.700402+0000","last_became_active":"2024-08-17T02:26:03.694448+0000","last_became_peered":"2024-08-17T02:26:03.694448+0000","last_unstale":"2024-08-17T02:26:03.700402+0000","last_undegraded":"2024-08-17T02:26:03.700402+0000","last_fullsized":"2024-08-17T02:26:03.700402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674804+0000","last_change":"2024-08-17T02:26:02.681358+0000","last_active":"2024-08-17T02:26:03.674804+0000","last_peered":"2024-08-17T02:26:03.674804+0000","last_clean":"2024-08-17T02:26:03.674804+0000","last_became_active":"2024-08-17T02:26:02.681132+0000","last_became_peered":"2024-08-17T02:26:02.681132+0000","last_unstale":"2024-08-17T02:26:03.674804+0000","last_undegraded":"2024-08-17T02:26:03.674804+0000","last_fullsized":"2024-08-17T02:26:03.674804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.687643+0000","last_change":"2024-08-17T02:26:03.685671+0000","last_active":"2024-08-17T02:26:03.687643+0000","last_peered":"2024-08-17T02:26:03.687643+0000","last_clean":"2024-08-17T02:26:03.687643+0000","last_became_active":"2024-08-17T02:26:03.685342+0000","last_became_peered":"2024-08-17T02:26:03.685342+0000","last_unstale":"2024-08-17T02:26:03.687643+0000","last_undegraded":"2024-08-17T02:26:03.687643+0000","last_fullsized":"2024-08-17T02:26:03.687643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:01:04.705817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.684533+0000","last_change":"2024-08-17T02:26:02.697313+0000","last_active":"2024-08-17T02:26:03.684533+0000","last_peered":"2024-08-17T02:26:03.684533+0000","last_clean":"2024-08-17T02:26:03.684533+0000","last_became_active":"2024-08-17T02:26:02.693931+0000","last_became_peered":"2024-08-17T02:26:02.693931+0000","last_unstale":"2024-08-17T02:26:03.684533+0000","last_undegraded":"2024-08-17T02:26:03.684533+0000","last_fullsized":"2024-08-17T02:26:03.684533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.704707+0000","last_change":"2024-08-17T02:26:03.698206+0000","last_active":"2024-08-17T02:26:03.704707+0000","last_peered":"2024-08-17T02:26:03.704707+0000","last_clean":"2024-08-17T02:26:03.704707+0000","last_became_active":"2024-08-17T02:26:03.696941+0000","last_became_peered":"2024-08-17T02:26:03.696941+0000","last_unstale":"2024-08-17T02:26:03.704707+0000","last_undegraded":"2024-08-17T02:26:03.704707+0000","last_fullsized":"2024-08-17T02:26:03.704707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:32.247498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674789+0000","last_change":"2024-08-17T02:26:02.689793+0000","last_active":"2024-08-17T02:26:03.674789+0000","last_peered":"2024-08-17T02:26:03.674789+0000","last_clean":"2024-08-17T02:26:03.674789+0000","last_became_active":"2024-08-17T02:26:02.689266+0000","last_became_peered":"2024-08-17T02:26:02.689266+0000","last_unstale":"2024-08-17T02:26:03.674789+0000","last_undegraded":"2024-08-17T02:26:03.674789+0000","last_fullsized":"2024-08-17T02:26:03.674789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700913+0000","last_change":"2024-08-17T02:26:03.696041+0000","last_active":"2024-08-17T02:26:03.700913+0000","last_peered":"2024-08-17T02:26:03.700913+0000","last_clean":"2024-08-17T02:26:03.700913+0000","last_became_active":"2024-08-17T02:26:03.695675+0000","last_became_peered":"2024-08-17T02:26:03.695675+0000","last_unstale":"2024-08-17T02:26:03.700913+0000","last_undegraded":"2024-08-17T02:26:03.700913+0000","last_fullsized":"2024-08-17T02:26:03.700913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:43:38.756879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.676108+0000","last_change":"2024-08-17T02:26:02.691075+0000","last_active":"2024-08-17T02:26:03.676108+0000","last_peered":"2024-08-17T02:26:03.676108+0000","last_clean":"2024-08-17T02:26:03.676108+0000","last_became_active":"2024-08-17T02:26:02.690601+0000","last_became_peered":"2024-08-17T02:26:02.690601+0000","last_unstale":"2024-08-17T02:26:03.676108+0000","last_undegraded":"2024-08-17T02:26:03.676108+0000","last_fullsized":"2024-08-17T02:26:03.676108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:52:15.556656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.687686+0000","last_change":"2024-08-17T02:26:03.686234+0000","last_active":"2024-08-17T02:26:03.687686+0000","last_peered":"2024-08-17T02:26:03.687686+0000","last_clean":"2024-08-17T02:26:03.687686+0000","last_became_active":"2024-08-17T02:26:03.685409+0000","last_became_peered":"2024-08-17T02:26:03.685409+0000","last_unstale":"2024-08-17T02:26:03.687686+0000","last_undegraded":"2024-08-17T02:26:03.687686+0000","last_fullsized":"2024-08-17T02:26:03.687686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:22.829763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:26:05.383303+0000","last_change":"2024-08-17T02:26:02.694328+0000","last_active":"2024-08-17T02:26:05.383303+0000","last_peered":"2024-08-17T02:26:05.383303+0000","last_clean":"2024-08-17T02:26:05.383303+0000","last_became_active":"2024-08-17T02:26:02.693978+0000","last_became_peered":"2024-08-17T02:26:02.693978+0000","last_unstale":"2024-08-17T02:26:05.383303+0000","last_undegraded":"2024-08-17T02:26:05.383303+0000","last_fullsized":"2024-08-17T02:26:05.383303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:46.046343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710044+0000","last_change":"2024-08-17T02:26:03.708726+0000","last_active":"2024-08-17T02:26:03.710044+0000","last_peered":"2024-08-17T02:26:03.710044+0000","last_clean":"2024-08-17T02:26:03.710044+0000","last_became_active":"2024-08-17T02:26:03.708552+0000","last_became_peered":"2024-08-17T02:26:03.708552+0000","last_unstale":"2024-08-17T02:26:03.710044+0000","last_undegraded":"2024-08-17T02:26:03.710044+0000","last_fullsized":"2024-08-17T02:26:03.710044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:58:32.287484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712327+0000","last_change":"2024-08-17T02:26:02.700098+0000","last_active":"2024-08-17T02:26:03.712327+0000","last_peered":"2024-08-17T02:26:03.712327+0000","last_clean":"2024-08-17T02:26:03.712327+0000","last_became_active":"2024-08-17T02:26:02.699846+0000","last_became_peered":"2024-08-17T02:26:02.699846+0000","last_unstale":"2024-08-17T02:26:03.712327+0000","last_undegraded":"2024-08-17T02:26:03.712327+0000","last_fullsized":"2024-08-17T02:26:03.712327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:57:36.233484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.681734+0000","last_change":"2024-08-17T02:26:03.678930+0000","last_active":"2024-08-17T02:26:03.681734+0000","last_peered":"2024-08-17T02:26:03.681734+0000","last_clean":"2024-08-17T02:26:03.681734+0000","last_became_active":"2024-08-17T02:26:03.678664+0000","last_became_peered":"2024-08-17T02:26:03.678664+0000","last_unstale":"2024-08-17T02:26:03.681734+0000","last_undegraded":"2024-08-17T02:26:03.681734+0000","last_fullsized":"2024-08-17T02:26:03.681734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674335+0000","last_change":"2024-08-17T02:26:02.691047+0000","last_active":"2024-08-17T02:26:03.674335+0000","last_peered":"2024-08-17T02:26:03.674335+0000","last_clean":"2024-08-17T02:26:03.674335+0000","last_became_active":"2024-08-17T02:26:02.690711+0000","last_became_peered":"2024-08-17T02:26:02.690711+0000","last_unstale":"2024-08-17T02:26:03.674335+0000","last_undegraded":"2024-08-17T02:26:03.674335+0000","last_fullsized":"2024-08-17T02:26:03.674335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:31.239087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.702744+0000","last_change":"2024-08-17T02:26:03.696174+0000","last_active":"2024-08-17T02:26:03.702744+0000","last_peered":"2024-08-17T02:26:03.702744+0000","last_clean":"2024-08-17T02:26:03.702744+0000","last_became_active":"2024-08-17T02:26:03.695719+0000","last_became_peered":"2024-08-17T02:26:03.695719+0000","last_unstale":"2024-08-17T02:26:03.702744+0000","last_undegraded":"2024-08-17T02:26:03.702744+0000","last_fullsized":"2024-08-17T02:26:03.702744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:47.054753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674669+0000","last_change":"2024-08-17T02:26:02.683782+0000","last_active":"2024-08-17T02:26:03.674669+0000","last_peered":"2024-08-17T02:26:03.674669+0000","last_clean":"2024-08-17T02:26:03.674669+0000","last_became_active":"2024-08-17T02:26:02.681787+0000","last_became_peered":"2024-08-17T02:26:02.681787+0000","last_unstale":"2024-08-17T02:26:03.674669+0000","last_undegraded":"2024-08-17T02:26:03.674669+0000","last_fullsized":"2024-08-17T02:26:03.674669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:22.121218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700808+0000","last_change":"2024-08-17T02:26:03.692440+0000","last_active":"2024-08-17T02:26:03.700808+0000","last_peered":"2024-08-17T02:26:03.700808+0000","last_clean":"2024-08-17T02:26:03.700808+0000","last_became_active":"2024-08-17T02:26:03.691740+0000","last_became_peered":"2024-08-17T02:26:03.691740+0000","last_unstale":"2024-08-17T02:26:03.700808+0000","last_undegraded":"2024-08-17T02:26:03.700808+0000","last_fullsized":"2024-08-17T02:26:03.700808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:47:33.144484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.674646+0000","last_change":"2024-08-17T02:26:02.682746+0000","last_active":"2024-08-17T02:26:03.674646+0000","last_peered":"2024-08-17T02:26:03.674646+0000","last_clean":"2024-08-17T02:26:03.674646+0000","last_became_active":"2024-08-17T02:26:02.677985+0000","last_became_peered":"2024-08-17T02:26:02.677985+0000","last_unstale":"2024-08-17T02:26:03.674646+0000","last_undegraded":"2024-08-17T02:26:03.674646+0000","last_fullsized":"2024-08-17T02:26:03.674646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:01.915740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.701339+0000","last_change":"2024-08-17T02:26:03.694939+0000","last_active":"2024-08-17T02:26:03.701339+0000","last_peered":"2024-08-17T02:26:03.701339+0000","last_clean":"2024-08-17T02:26:03.701339+0000","last_became_active":"2024-08-17T02:26:03.694230+0000","last_became_peered":"2024-08-17T02:26:03.694230+0000","last_unstale":"2024-08-17T02:26:03.701339+0000","last_undegraded":"2024-08-17T02:26:03.701339+0000","last_fullsized":"2024-08-17T02:26:03.701339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:06.399989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713165+0000","last_change":"2024-08-17T02:26:02.695510+0000","last_active":"2024-08-17T02:26:03.713165+0000","last_peered":"2024-08-17T02:26:03.713165+0000","last_clean":"2024-08-17T02:26:03.713165+0000","last_became_active":"2024-08-17T02:26:02.695315+0000","last_became_peered":"2024-08-17T02:26:02.695315+0000","last_unstale":"2024-08-17T02:26:03.713165+0000","last_undegraded":"2024-08-17T02:26:03.713165+0000","last_fullsized":"2024-08-17T02:26:03.713165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:44:16.185045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710253+0000","last_change":"2024-08-17T02:26:03.704528+0000","last_active":"2024-08-17T02:26:03.710253+0000","last_peered":"2024-08-17T02:26:03.710253+0000","last_clean":"2024-08-17T02:26:03.710253+0000","last_became_active":"2024-08-17T02:26:03.693099+0000","last_became_peered":"2024-08-17T02:26:03.693099+0000","last_unstale":"2024-08-17T02:26:03.710253+0000","last_undegraded":"2024-08-17T02:26:03.710253+0000","last_fullsized":"2024-08-17T02:26:03.710253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:47.198158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.707777+0000","last_change":"2024-08-17T02:26:03.699962+0000","last_active":"2024-08-17T02:26:03.707777+0000","last_peered":"2024-08-17T02:26:03.707777+0000","last_clean":"2024-08-17T02:26:03.707777+0000","last_became_active":"2024-08-17T02:26:03.699542+0000","last_became_peered":"2024-08-17T02:26:03.699542+0000","last_unstale":"2024-08-17T02:26:03.707777+0000","last_undegraded":"2024-08-17T02:26:03.707777+0000","last_fullsized":"2024-08-17T02:26:03.707777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:00:59.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.713543+0000","last_change":"2024-08-17T02:26:02.699093+0000","last_active":"2024-08-17T02:26:03.713543+0000","last_peered":"2024-08-17T02:26:03.713543+0000","last_clean":"2024-08-17T02:26:03.713543+0000","last_became_active":"2024-08-17T02:26:02.698750+0000","last_became_peered":"2024-08-17T02:26:02.698750+0000","last_unstale":"2024-08-17T02:26:03.713543+0000","last_undegraded":"2024-08-17T02:26:03.713543+0000","last_fullsized":"2024-08-17T02:26:03.713543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:16:01.999696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700379+0000","last_change":"2024-08-17T02:26:03.695207+0000","last_active":"2024-08-17T02:26:03.700379+0000","last_peered":"2024-08-17T02:26:03.700379+0000","last_clean":"2024-08-17T02:26:03.700379+0000","last_became_active":"2024-08-17T02:26:03.694474+0000","last_became_peered":"2024-08-17T02:26:03.694474+0000","last_unstale":"2024-08-17T02:26:03.700379+0000","last_undegraded":"2024-08-17T02:26:03.700379+0000","last_fullsized":"2024-08-17T02:26:03.700379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.712848+0000","last_change":"2024-08-17T02:26:02.694813+0000","last_active":"2024-08-17T02:26:03.712848+0000","last_peered":"2024-08-17T02:26:03.712848+0000","last_clean":"2024-08-17T02:26:03.712848+0000","last_became_active":"2024-08-17T02:26:02.694536+0000","last_became_peered":"2024-08-17T02:26:02.694536+0000","last_unstale":"2024-08-17T02:26:03.712848+0000","last_undegraded":"2024-08-17T02:26:03.712848+0000","last_fullsized":"2024-08-17T02:26:03.712848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:06.564818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.700480+0000","last_change":"2024-08-17T02:26:03.697467+0000","last_active":"2024-08-17T02:26:03.700480+0000","last_peered":"2024-08-17T02:26:03.700480+0000","last_clean":"2024-08-17T02:26:03.700480+0000","last_became_active":"2024-08-17T02:26:03.697216+0000","last_became_peered":"2024-08-17T02:26:03.697216+0000","last_unstale":"2024-08-17T02:26:03.700480+0000","last_undegraded":"2024-08-17T02:26:03.700480+0000","last_fullsized":"2024-08-17T02:26:03.700480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:26:25.587228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.711824+0000","last_change":"2024-08-17T02:26:02.690442+0000","last_active":"2024-08-17T02:26:03.711824+0000","last_peered":"2024-08-17T02:26:03.711824+0000","last_clean":"2024-08-17T02:26:03.711824+0000","last_became_active":"2024-08-17T02:26:02.689103+0000","last_became_peered":"2024-08-17T02:26:02.689103+0000","last_unstale":"2024-08-17T02:26:03.711824+0000","last_undegraded":"2024-08-17T02:26:03.711824+0000","last_fullsized":"2024-08-17T02:26:03.711824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:59:18.508809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710009+0000","last_change":"2024-08-17T02:26:03.705516+0000","last_active":"2024-08-17T02:26:03.710009+0000","last_peered":"2024-08-17T02:26:03.710009+0000","last_clean":"2024-08-17T02:26:03.710009+0000","last_became_active":"2024-08-17T02:26:03.705299+0000","last_became_peered":"2024-08-17T02:26:03.705299+0000","last_unstale":"2024-08-17T02:26:03.710009+0000","last_undegraded":"2024-08-17T02:26:03.710009+0000","last_fullsized":"2024-08-17T02:26:03.710009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:02.657876+0000","last_clean_scrub_stamp":"2024-08-17T02:26:02.657876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:32.815352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:26:03.710612+0000","last_change":"2024-08-17T02:26:02.698824+0000","last_active":"2024-08-17T02:26:03.710612+0000","last_peered":"2024-08-17T02:26:03.710612+0000","last_clean":"2024-08-17T02:26:03.710612+0000","last_became_active":"2024-08-17T02:26:02.698592+0000","last_became_peered":"2024-08-17T02:26:02.698592+0000","last_unstale":"2024-08-17T02:26:03.710612+0000","last_undegraded":"2024-08-17T02:26:03.710612+0000","last_fullsized":"2024-08-17T02:26:03.710612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:01.649466+0000","last_clean_scrub_stamp":"2024-08-17T02:26:01.649466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:50:37.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1280000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9529999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.226}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2280000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.028}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:13.156 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:26:13.156 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:26:13.156 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:26:13.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:26:13.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.338+0000 7f787c600640 1 Processor -- start 2024-08-17T02:26:13.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.338+0000 7f787c600640 1 -- start start 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.339+0000 7f787c600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.339+0000 7f787c600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7874155df0 0x7f78740ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.339+0000 7f787c600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7874156670 con 0x7f787406d7f0 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f787c600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740b0350 con 0x7f7874155df0 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f787c600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787406e5e0 con 0x7f7874155a20 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f787a600640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f787406d7f0 0x7f78740ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55992/0 (socket says 172.21.15.146:55992) 2024-08-17T02:26:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f787a600640 1 -- 172.21.15.146:0/2017178738 learned_addr learned my addr 172.21.15.146:0/2017178738 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879200640 1 --2- 172.21.15.146:0/2017178738 >> v2:172.21.15.150:3300/0 conn(0x7f7874155df0 0x7f78740ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879c00640 1 --2- 172.21.15.146:0/2017178738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7873e00640 1 -- 172.21.15.146:0/2017178738 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284864503 0 0) 0x7f7874156670 con 0x7f787406d7f0 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7873e00640 1 -- 172.21.15.146:0/2017178738 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f785c0034e0 con 0x7f787406d7f0 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879c00640 1 -- 172.21.15.146:0/2017178738 >> v2:172.21.15.150:3300/0 conn(0x7f7874155df0 msgr2=0x7f78740ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879c00640 1 --2- 172.21.15.146:0/2017178738 >> v2:172.21.15.150:3300/0 conn(0x7f7874155df0 0x7f78740ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879c00640 1 -- 172.21.15.146:0/2017178738 >> v1:172.21.15.146:6789/0 conn(0x7f787406d7f0 legacy=0x7f78740ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.340+0000 7f7879c00640 1 -- 172.21.15.146:0/2017178738 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787406e8c0 con 0x7f7874155a20 2024-08-17T02:26:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f7879c00640 1 --2- 172.21.15.146:0/2017178738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740adf10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7868009e60 tx=0x7f7868009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1047f40b86aec02d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f7873e00640 1 -- 172.21.15.146:0/2017178738 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868007550 con 0x7f7874155a20 2024-08-17T02:26:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f7873e00640 1 -- 172.21.15.146:0/2017178738 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786802d050 con 0x7f7874155a20 2024-08-17T02:26:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f7873e00640 1 -- 172.21.15.146:0/2017178738 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868007920 con 0x7f7874155a20 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f787c600640 1 -- 172.21.15.146:0/2017178738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 msgr2=0x7f78740adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.342+0000 7f787c600640 1 --2- 172.21.15.146:0/2017178738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740adf10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7868009e60 tx=0x7f7868009780 comp rx=0 tx=0).stop 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 -- 172.21.15.146:0/2017178738 shutdown_connections 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 --2- 172.21.15.146:0/2017178738 >> v2:172.21.15.150:3300/0 conn(0x7f7874155df0 0x7f78740ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 --2- 172.21.15.146:0/2017178738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740adf10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 -- 172.21.15.146:0/2017178738 >> 172.21.15.146:0/2017178738 conn(0x7f78740cb9b0 msgr2=0x7f78740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 -- 172.21.15.146:0/2017178738 shutdown_connections 2024-08-17T02:26:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.343+0000 7f787c600640 1 -- 172.21.15.146:0/2017178738 wait complete. 2024-08-17T02:26:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.344+0000 7f787c600640 1 Processor -- start 2024-08-17T02:26:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.344+0000 7f787c600640 1 -- start start 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 0x7f78740c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740ab540 con 0x7f7874155df0 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740aa830 con 0x7f787406d7f0 2024-08-17T02:26:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787c600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78740c1990 con 0x7f7874155a20 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40544/0 (socket says 172.21.15.146:40544) 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f787a600640 1 -- 172.21.15.146:0/1589674499 learned_addr learned my addr 172.21.15.146:0/1589674499 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f7879c00640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 0x7f78740c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.345+0000 7f7879200640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 -- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 msgr2=0x7f78740aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 -- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 msgr2=0x7f78740c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 0x7f78740c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 -- 172.21.15.146:0/1589674499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009a20 con 0x7f7874155df0 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f7879c00640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 0x7f78740c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787a600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786c0010e0 tx=0x7f786c007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c005aa0 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c005c00 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78740ab7e0 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0070d0 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.346+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78740abac0 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.347+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7874064db0 con 0x7f7874155df0 2024-08-17T02:26:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.348+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f786c007500 con 0x7f7874155df0 2024-08-17T02:26:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.349+0000 7f7870c00640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 0x7f7854067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.349+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f786c081980 con 0x7f7874155df0 2024-08-17T02:26:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.349+0000 7f7879c00640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 0x7f7854067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.350+0000 7f7879c00640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 0x7f7854067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7868034000 tx=0x7f7868037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.353+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f786c04be40 con 0x7f7874155df0 2024-08-17T02:26:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.565+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7874154a40 con 0x7f7874155df0 2024-08-17T02:26:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.565+0000 7f7870c00640 1 -- 172.21.15.146:0/1589674499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f786c017080 con 0x7f7874155df0 2024-08-17T02:26:13.566 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:13.566 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 msgr2=0x7f7854067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 0x7f7854067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7868034000 tx=0x7f7868037000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 msgr2=0x7f787406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786c0010e0 tx=0x7f786c007d40 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 shutdown_connections 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7854065150 0x7f7854067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7874155df0 0x7f787406c9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7874155a20 0x7f78740aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 --2- 172.21.15.146:0/1589674499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f787406d7f0 0x7f78740c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 >> 172.21.15.146:0/1589674499 conn(0x7f78740cb9b0 msgr2=0x7f7874158830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 shutdown_connections 2024-08-17T02:26:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.567+0000 7f787c600640 1 -- 172.21.15.146:0/1589674499 wait complete. 2024-08-17T02:26:13.584 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:26:13.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.732+0000 7fa1dfc00640 1 Processor -- start 2024-08-17T02:26:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.732+0000 7fa1dfc00640 1 -- start start 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 0x7fa1d80ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cf280 0x7fa1d80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80cb560 con 0x7fa1d80cf280 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80cf7e0 con 0x7fa1d8159350 2024-08-17T02:26:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1dfc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80cfac0 con 0x7fa1d8158f80 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.733+0000 7fa1ddc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cf280 0x7fa1d80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa1d80cf280 0x7fa1d80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40548/0 (socket says 172.21.15.146:40548) 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 -- 172.21.15.146:0/89370024 learned_addr learned my addr 172.21.15.146:0/89370024 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1d7e00640 1 --2- 172.21.15.146:0/89370024 >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 0x7fa1d80ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1dd200640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 -- 172.21.15.146:0/89370024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 msgr2=0x7fa1d80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d80ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 -- 172.21.15.146:0/89370024 >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 msgr2=0x7fa1d80ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/89370024 >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 0x7fa1d80ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1ddc00640 1 -- 172.21.15.146:0/89370024 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80caf10 con 0x7fa1d80cf280 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1dd200640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.734+0000 7fa1d7e00640 1 --2- 172.21.15.146:0/89370024 >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 0x7fa1d80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.735+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cf280 0x7fa1d80cd8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8064240 tx=0x7fa1d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4bd2e758d8d5c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1d7400640 1 -- 172.21.15.146:0/89370024 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0031400 con 0x7fa1d80cf280 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1d7400640 1 -- 172.21.15.146:0/89370024 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d002d050 con 0x7fa1d80cf280 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1d7400640 1 -- 172.21.15.146:0/89370024 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00317d0 con 0x7fa1d80cf280 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 -- 172.21.15.146:0/89370024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cf280 msgr2=0x7fa1d80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cf280 0x7fa1d80cd8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8064240 tx=0x7fa1d0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 -- 172.21.15.146:0/89370024 shutdown_connections 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d80cf280 0x7fa1d80cd8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/89370024 >> v2:172.21.15.150:3300/0 conn(0x7fa1d8159350 0x7fa1d80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/89370024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 -- 172.21.15.146:0/89370024 >> 172.21.15.146:0/89370024 conn(0x7fa1d80cfd90 msgr2=0x7fa1d80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.736+0000 7fa1dfc00640 1 -- 172.21.15.146:0/89370024 shutdown_connections 2024-08-17T02:26:13.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.737+0000 7fa1dfc00640 1 -- 172.21.15.146:0/89370024 wait complete. 2024-08-17T02:26:13.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.738+0000 7fa1dfc00640 1 Processor -- start 2024-08-17T02:26:13.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.738+0000 7fa1dfc00640 1 -- start start 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80cf280 0x7fa1d815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815a210 con 0x7fa1d8159350 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80b3ce0 con 0x7fa1d80cf280 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dfc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d815bfc0 con 0x7fa1d8158f80 2024-08-17T02:26:13.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1ddc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1ddc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40562/0 (socket says 172.21.15.146:40562) 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1ddc00640 1 -- 172.21.15.146:0/2674617702 learned_addr learned my addr 172.21.15.146:0/2674617702 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1d7e00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.739+0000 7fa1dd200640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80cf280 0x7fa1d815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 -- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 msgr2=0x7fa1d8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 -- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80cf280 msgr2=0x7fa1d815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80cf280 0x7fa1d815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 -- 172.21.15.146:0/2674617702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d0009ae0 con 0x7fa1d8159350 2024-08-17T02:26:13.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.740+0000 7fa1ddc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009f50 tx=0x7fa1d0034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.741+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00077e0 con 0x7fa1d8159350 2024-08-17T02:26:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.741+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0007940 con 0x7fa1d8159350 2024-08-17T02:26:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.741+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d815c2a0 con 0x7fa1d8159350 2024-08-17T02:26:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.741+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007cc0 con 0x7fa1d8159350 2024-08-17T02:26:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.741+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d815c860 con 0x7fa1d8159350 2024-08-17T02:26:13.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.742+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d80b3e50 con 0x7fa1d8159350 2024-08-17T02:26:13.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.743+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa1d003c630 con 0x7fa1d8159350 2024-08-17T02:26:13.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.744+0000 7fa1cbe00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 0x7fa1b8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.744+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1d00a3100 con 0x7fa1d8159350 2024-08-17T02:26:13.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.744+0000 7fa1dd200640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 0x7fa1b8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.745+0000 7fa1dd200640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 0x7fa1b8067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00bc80 tx=0x7fa1cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.748+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa1d00711d0 con 0x7fa1d8159350 2024-08-17T02:26:13.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.923+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1d8064db0 con 0x7fa1d8159350 2024-08-17T02:26:13.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.924+0000 7fa1cbe00640 1 -- 172.21.15.146:0/2674617702 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa1d00747f0 con 0x7fa1d8159350 2024-08-17T02:26:13.925 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:13.925 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 msgr2=0x7fa1b8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 0x7fa1b8067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00bc80 tx=0x7fa1cc008040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 msgr2=0x7fa1d8159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009f50 tx=0x7fa1d0034000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 shutdown_connections 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa1b8065180 0x7fa1b8067630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1d8159350 0x7fa1d8159cd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa1d8158f80 0x7fa1d8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 --2- 172.21.15.146:0/2674617702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa1d80cf280 0x7fa1d815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 >> 172.21.15.146:0/2674617702 conn(0x7fa1d80cfd90 msgr2=0x7fa1d8068160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 shutdown_connections 2024-08-17T02:26:13.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:13.926+0000 7fa1dfc00640 1 -- 172.21.15.146:0/2674617702 wait complete. 2024-08-17T02:26:13.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:13.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.093+0000 7fc543e00640 1 Processor -- start 2024-08-17T02:26:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.093+0000 7fc543e00640 1 -- start start 2024-08-17T02:26:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc543e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc53c153320 0x7fc53c0aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc543e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc53c159340 0x7fc53c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc543e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0ad940 con 0x7fc53c067210 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc543e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c06e700 con 0x7fc53c159340 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc543e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c067620 con 0x7fc53c153320 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc540a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc53c159340 0x7fc53c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc540a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc53c159340 0x7fc53c066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40570/0 (socket says 172.21.15.146:40570) 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc540a00640 1 -- 172.21.15.146:0/4105302319 learned_addr learned my addr 172.21.15.146:0/4105302319 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc541400640 1 --2- 172.21.15.146:0/4105302319 >> v2:172.21.15.150:3300/0 conn(0x7fc53c153320 0x7fc53c0aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.094+0000 7fc541e00640 1 --1- 172.21.15.146:0/4105302319 >> v1:172.21.15.146:6789/0 conn(0x7fc53c067210 0x7fc53c0addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56006/0 (socket says 172.21.15.146:56006) 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.095+0000 7fc540a00640 1 -- 172.21.15.146:0/4105302319 >> v2:172.21.15.150:3300/0 conn(0x7fc53c153320 msgr2=0x7fc53c0aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.095+0000 7fc540a00640 1 --2- 172.21.15.146:0/4105302319 >> v2:172.21.15.150:3300/0 conn(0x7fc53c153320 0x7fc53c0aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.095+0000 7fc540a00640 1 -- 172.21.15.146:0/4105302319 >> v1:172.21.15.146:6789/0 conn(0x7fc53c067210 legacy=0x7fc53c0addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.095+0000 7fc540a00640 1 -- 172.21.15.146:0/4105302319 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c159b20 con 0x7fc53c159340 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.095+0000 7fc53be00640 1 -- 172.21.15.146:0/4105302319 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351370677 0 0) 0x7fc53c0ad940 con 0x7fc53c067210 2024-08-17T02:26:14.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc540a00640 1 --2- 172.21.15.146:0/4105302319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c066cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc53c066810 tx=0x7fc5280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca33ccacf8b29e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc53be00640 1 -- 172.21.15.146:0/4105302319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52802adf0 con 0x7fc53c159340 2024-08-17T02:26:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc53be00640 1 -- 172.21.15.146:0/4105302319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528032440 con 0x7fc53c159340 2024-08-17T02:26:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc53be00640 1 -- 172.21.15.146:0/4105302319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280327e0 con 0x7fc53c159340 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc543e00640 1 -- 172.21.15.146:0/4105302319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 msgr2=0x7fc53c066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.096+0000 7fc543e00640 1 --2- 172.21.15.146:0/4105302319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c066cd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc53c066810 tx=0x7fc5280091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 -- 172.21.15.146:0/4105302319 shutdown_connections 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 --2- 172.21.15.146:0/4105302319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c066cd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 --2- 172.21.15.146:0/4105302319 >> v2:172.21.15.150:3300/0 conn(0x7fc53c153320 0x7fc53c0aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 -- 172.21.15.146:0/4105302319 >> 172.21.15.146:0/4105302319 conn(0x7fc53c06d8b0 msgr2=0x7fc53c06dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 -- 172.21.15.146:0/4105302319 shutdown_connections 2024-08-17T02:26:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.097+0000 7fc543e00640 1 -- 172.21.15.146:0/4105302319 wait complete. 2024-08-17T02:26:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.098+0000 7fc543e00640 1 Processor -- start 2024-08-17T02:26:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.098+0000 7fc543e00640 1 -- start start 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc53c067210 0x7fc53c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53c153320 0x7fc53c168810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c16bc90 con 0x7fc53c159340 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b1750 con 0x7fc53c067210 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.099+0000 7fc543e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0b0b40 con 0x7fc53c153320 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40584/0 (socket says 172.21.15.146:40584) 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 -- 172.21.15.146:0/358146214 learned_addr learned my addr 172.21.15.146:0/358146214 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc540a00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53c153320 0x7fc53c168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541400640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc53c067210 0x7fc53c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 -- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53c153320 msgr2=0x7fc53c168810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53c153320 0x7fc53c168810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 -- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc53c067210 msgr2=0x7fc53c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc53c067210 0x7fc53c0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 -- 172.21.15.146:0/358146214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc528009450 con 0x7fc53c159340 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc541e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c990 tx=0x7fc5340016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.100+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534005d60 con 0x7fc53c159340 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.101+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53400a640 con 0x7fc53c159340 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.101+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400aa00 con 0x7fc53c159340 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.101+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0b0e20 con 0x7fc53c159340 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.101+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0b13e0 con 0x7fc53c159340 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.102+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c064db0 con 0x7fc53c159340 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.102+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc5340070f0 con 0x7fc53c159340 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.104+0000 7fc538c00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 0x7fc51c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.104+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc534082160 con 0x7fc53c159340 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.104+0000 7fc541400640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 0x7fc51c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.104+0000 7fc541400640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 0x7fc51c067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d20 tx=0x7fc5300090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.107+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc5340502b0 con 0x7fc53c159340 2024-08-17T02:26:14.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.276+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc53c0008d0 con 0x7fc53c159340 2024-08-17T02:26:14.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.277+0000 7fc538c00640 1 -- 172.21.15.146:0/358146214 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5340538d0 con 0x7fc53c159340 2024-08-17T02:26:14.278 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:14.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 msgr2=0x7fc51c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 0x7fc51c067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc530009d20 tx=0x7fc5300090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 msgr2=0x7fc53c168d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c990 tx=0x7fc5340016c0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 shutdown_connections 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc51c065150 0x7fc51c067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc53c159340 0x7fc53c168d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc53c153320 0x7fc53c168810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 --2- 172.21.15.146:0/358146214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc53c067210 0x7fc53c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 >> 172.21.15.146:0/358146214 conn(0x7fc53c06d8b0 msgr2=0x7fc53c06dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 shutdown_connections 2024-08-17T02:26:14.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.279+0000 7fc543e00640 1 -- 172.21.15.146:0/358146214 wait complete. 2024-08-17T02:26:14.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.445+0000 7fccb0a00640 1 Processor -- start 2024-08-17T02:26:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.445+0000 7fccb0a00640 1 -- start start 2024-08-17T02:26:14.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.446+0000 7fccb0a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.446+0000 7fccb0a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fccac0abb00 0x7fccac0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.446+0000 7fccb0a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac0ab130 con 0x7fccac156c50 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.446+0000 7fccb0a00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac0ae5a0 con 0x7fccac0abb00 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.446+0000 7fccb0a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0ae2c0 con 0x7fccac0adcf0 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fccac156c50 0x7fccac0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56014/0 (socket says 172.21.15.146:56014) 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9e00640 1 -- 172.21.15.146:0/1786820570 learned_addr learned my addr 172.21.15.146:0/1786820570 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9400640 1 --2- 172.21.15.146:0/1786820570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fccaa800640 1 --2- 172.21.15.146:0/1786820570 >> v2:172.21.15.150:3300/0 conn(0x7fccac0abb00 0x7fccac0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca8a00640 1 -- 172.21.15.146:0/1786820570 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617159236 0 0) 0x7fccac0ab130 con 0x7fccac156c50 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca8a00640 1 -- 172.21.15.146:0/1786820570 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc900034e0 con 0x7fccac156c50 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9400640 1 -- 172.21.15.146:0/1786820570 >> v2:172.21.15.150:3300/0 conn(0x7fccac0abb00 msgr2=0x7fccac0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9400640 1 --2- 172.21.15.146:0/1786820570 >> v2:172.21.15.150:3300/0 conn(0x7fccac0abb00 0x7fccac0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9400640 1 -- 172.21.15.146:0/1786820570 >> v1:172.21.15.146:6789/0 conn(0x7fccac156c50 legacy=0x7fccac0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.447+0000 7fcca9400640 1 -- 172.21.15.146:0/1786820570 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0aaae0 con 0x7fccac0adcf0 2024-08-17T02:26:14.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.448+0000 7fcca9400640 1 --2- 172.21.15.146:0/1786820570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0ab5c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009850 tx=0x7fcc980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beb5fc18409e3965 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fcca8a00640 1 -- 172.21.15.146:0/1786820570 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9802ad00 con 0x7fccac0adcf0 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fcca8a00640 1 -- 172.21.15.146:0/1786820570 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9802ae60 con 0x7fccac0adcf0 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fcca8a00640 1 -- 172.21.15.146:0/1786820570 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98032670 con 0x7fccac0adcf0 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 -- 172.21.15.146:0/1786820570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 msgr2=0x7fccac0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 --2- 172.21.15.146:0/1786820570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0ab5c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009850 tx=0x7fcc980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 -- 172.21.15.146:0/1786820570 shutdown_connections 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 --2- 172.21.15.146:0/1786820570 >> v2:172.21.15.150:3300/0 conn(0x7fccac0abb00 0x7fccac0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 --2- 172.21.15.146:0/1786820570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0ab5c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 -- 172.21.15.146:0/1786820570 >> 172.21.15.146:0/1786820570 conn(0x7fccac067750 msgr2=0x7fccac0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 -- 172.21.15.146:0/1786820570 shutdown_connections 2024-08-17T02:26:14.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.449+0000 7fccb0a00640 1 -- 172.21.15.146:0/1786820570 wait complete. 2024-08-17T02:26:14.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.451+0000 7fccb0a00640 1 Processor -- start 2024-08-17T02:26:14.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.451+0000 7fccb0a00640 1 -- start start 2024-08-17T02:26:14.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccac0abb00 0x7fccac1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15c5d0 con 0x7fccac156c50 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15b530 con 0x7fccac0abb00 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccb0a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac15b810 con 0x7fccac0adcf0 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccaa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccaa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40598/0 (socket says 172.21.15.146:40598) 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fccaa800640 1 -- 172.21.15.146:0/2502855889 learned_addr learned my addr 172.21.15.146:0/2502855889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fcca9400640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.452+0000 7fcca9e00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccac0abb00 0x7fccac1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 -- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 msgr2=0x7fccac0a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 -- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccac0abb00 msgr2=0x7fccac1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccac0abb00 0x7fccac1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 -- 172.21.15.146:0/2502855889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009390 con 0x7fccac156c50 2024-08-17T02:26:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccaa800640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009ef0 tx=0x7fcca400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca400ce10 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca400f040 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac15baf0 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40146d0 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.453+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac15c0b0 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.454+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac15c2a0 con 0x7fccac156c50 2024-08-17T02:26:14.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.455+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcca4014a80 con 0x7fccac156c50 2024-08-17T02:26:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.456+0000 7fcca1600640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 0x7fcc8c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.456+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcca4083200 con 0x7fccac156c50 2024-08-17T02:26:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.456+0000 7fcca9e00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 0x7fcc8c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.457+0000 7fcca9e00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 0x7fcc8c067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005840 tx=0x7fcc9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.460+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcca4051390 con 0x7fccac156c50 2024-08-17T02:26:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.630+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccac071050 con 0x7fccac156c50 2024-08-17T02:26:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.630+0000 7fcca1600640 1 -- 172.21.15.146:0/2502855889 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcca40549b0 con 0x7fccac156c50 2024-08-17T02:26:14.631 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 msgr2=0x7fcc8c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 0x7fcc8c067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005840 tx=0x7fcc9c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 msgr2=0x7fccac0a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009ef0 tx=0x7fcca400b040 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 shutdown_connections 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcc8c065180 0x7fcc8c067630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccac156c50 0x7fccac0a9e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccac0adcf0 0x7fccac0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 --2- 172.21.15.146:0/2502855889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccac0abb00 0x7fccac1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 >> 172.21.15.146:0/2502855889 conn(0x7fccac067750 msgr2=0x7fccac068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 shutdown_connections 2024-08-17T02:26:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.632+0000 7fccb0a00640 1 -- 172.21.15.146:0/2502855889 wait complete. 2024-08-17T02:26:14.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.801+0000 7f430ac00640 1 Processor -- start 2024-08-17T02:26:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.801+0000 7f430ac00640 1 -- start start 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.802+0000 7f430ac00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4304155a80 0x7f430406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.802+0000 7f430ac00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43041598f0 con 0x7f43040c7db0 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.802+0000 7f430ac00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4304159bd0 con 0x7f43040c92e0 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.802+0000 7f430ac00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4304159eb0 con 0x7f4304155a80 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4304155a80 0x7f430406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4304155a80 0x7f430406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41684/0 (socket says 172.21.15.146:41684) 2024-08-17T02:26:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43040c7db0 0x7f43040c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53066/0 (socket says 172.21.15.146:53066) 2024-08-17T02:26:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 -- 172.21.15.146:0/2994223256 learned_addr learned my addr 172.21.15.146:0/2994223256 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 -- 172.21.15.146:0/2994223256 >> v1:172.21.15.150:6789/0 conn(0x7f43040c92e0 legacy=0x7f43040aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 -- 172.21.15.146:0/2994223256 >> v1:172.21.15.146:6789/0 conn(0x7f43040c7db0 legacy=0x7f43040c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.803+0000 7f4303e00640 1 -- 172.21.15.146:0/2994223256 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430415a190 con 0x7f4304155a80 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.804+0000 7f4303e00640 1 --2- 172.21.15.146:0/2994223256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4304155a80 0x7f430406dc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009910 tx=0x7f42f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee947badf2399128 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.804+0000 7f4302a00640 1 -- 172.21.15.146:0/2994223256 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f402f510 con 0x7f4304155a80 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.804+0000 7f4302a00640 1 -- 172.21.15.146:0/2994223256 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f402d050 con 0x7f4304155a80 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.804+0000 7f4302a00640 1 -- 172.21.15.146:0/2994223256 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f402f8e0 con 0x7f4304155a80 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 -- 172.21.15.146:0/2994223256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4304155a80 msgr2=0x7f430406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 --2- 172.21.15.146:0/2994223256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4304155a80 0x7f430406dc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009910 tx=0x7f42f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 -- 172.21.15.146:0/2994223256 shutdown_connections 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 --2- 172.21.15.146:0/2994223256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4304155a80 0x7f430406dc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 -- 172.21.15.146:0/2994223256 >> 172.21.15.146:0/2994223256 conn(0x7f4304067750 msgr2=0x7f43040c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 -- 172.21.15.146:0/2994223256 shutdown_connections 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.805+0000 7f430ac00640 1 -- 172.21.15.146:0/2994223256 wait complete. 2024-08-17T02:26:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.806+0000 7f430ac00640 1 Processor -- start 2024-08-17T02:26:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.807+0000 7f430ac00640 1 -- start start 2024-08-17T02:26:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.807+0000 7f430ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.807+0000 7f430ac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43040c92e0 0x7f43040ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.807+0000 7f430ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4304155a80 0x7f43040ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f430ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43040acba0 con 0x7f43040c7db0 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f430ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43040ad9d0 con 0x7f4304155a80 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f430ac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43040ade60 con 0x7f43040c92e0 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43040c92e0 0x7f43040ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41700/0 (socket says 172.21.15.146:41700) 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4308c00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4304155a80 0x7f43040ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 -- 172.21.15.146:0/3880342945 learned_addr learned my addr 172.21.15.146:0/3880342945 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 -- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43040c92e0 msgr2=0x7f43040ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43040c92e0 0x7f43040ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 -- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4304155a80 msgr2=0x7f43040ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4304155a80 0x7f43040ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.808+0000 7f4303e00640 1 -- 172.21.15.146:0/3880342945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4009450 con 0x7f43040c7db0 2024-08-17T02:26:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f4303e00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009970 tx=0x7f42f4035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4031760 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f40318c0 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4031c80 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43040acdc0 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.809+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43040ad380 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.810+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4304071050 con 0x7f43040c7db0 2024-08-17T02:26:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.811+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f42f403b620 con 0x7f43040c7db0 2024-08-17T02:26:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.812+0000 7f42fb400640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 0x7f42e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.812+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42f40a3170 con 0x7f43040c7db0 2024-08-17T02:26:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.812+0000 7f4303400640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 0x7f42e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.813+0000 7f4303400640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 0x7f42e4067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43040aafe0 tx=0x7f42f0007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.816+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f42f4071240 con 0x7f43040c7db0 2024-08-17T02:26:14.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.988+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43040afc50 con 0x7f43040c7db0 2024-08-17T02:26:14.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.988+0000 7f42fb400640 1 -- 172.21.15.146:0/3880342945 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42f4074860 con 0x7f43040c7db0 2024-08-17T02:26:14.990 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.990+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 msgr2=0x7f42e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.990+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 0x7f42e4067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43040aafe0 tx=0x7f42f0007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.990+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 msgr2=0x7f43041573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.990+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009970 tx=0x7f42f4035000 comp rx=0 tx=0).stop 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 shutdown_connections 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f42e4065150 0x7f42e4067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4304155a80 0x7f43040ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f43040c92e0 0x7f43040ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 --2- 172.21.15.146:0/3880342945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040c7db0 0x7f43041573b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 >> 172.21.15.146:0/3880342945 conn(0x7f4304067750 msgr2=0x7f43041503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 shutdown_connections 2024-08-17T02:26:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:14.991+0000 7f430ac00640 1 -- 172.21.15.146:0/3880342945 wait complete. 2024-08-17T02:26:15.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:15.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.155+0000 7f53a3200640 1 Processor -- start 2024-08-17T02:26:15.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.155+0000 7f53a3200640 1 -- start start 2024-08-17T02:26:15.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a4159ca0 0x7f53a40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a3200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53a40ca8a0 0x7f53a40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40cadc0 con 0x7f53a40ccad0 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a3200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a40cd6e0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40ccf70 con 0x7f53a4159ca0 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53a40ca8a0 0x7f53a40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53a40ca8a0 0x7f53a40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41710/0 (socket says 172.21.15.146:41710) 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a1400640 1 -- 172.21.15.146:0/3120720284 learned_addr learned my addr 172.21.15.146:0/3120720284 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a2800640 1 --1- 172.21.15.146:0/3120720284 >> v1:172.21.15.146:6789/0 conn(0x7f53a40ccad0 0x7f53a40cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53068/0 (socket says 172.21.15.146:53068) 2024-08-17T02:26:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.156+0000 7f53a1e00640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a4159ca0 0x7f53a40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.157+0000 7f53a1400640 1 -- 172.21.15.146:0/3120720284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a4159ca0 msgr2=0x7f53a40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.157+0000 7f53a1400640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a4159ca0 0x7f53a40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.157+0000 7f53a1400640 1 -- 172.21.15.146:0/3120720284 >> v1:172.21.15.146:6789/0 conn(0x7f53a40ccad0 legacy=0x7f53a40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.157+0000 7f53a1400640 1 -- 172.21.15.146:0/3120720284 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40cb060 con 0x7f53a40ca8a0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.157+0000 7f53a0a00640 1 -- 172.21.15.146:0/3120720284 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408309962 0 0) 0x7f53a40cadc0 con 0x7f53a40ccad0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a1400640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40cc590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5390009910 tx=0x7f53900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc317e16f9eb275 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a0a00640 1 -- 172.21.15.146:0/3120720284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539002ae40 con 0x7f53a40ca8a0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a0a00640 1 -- 172.21.15.146:0/3120720284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5390032440 con 0x7f53a40ca8a0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a0a00640 1 -- 172.21.15.146:0/3120720284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900327e0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a3200640 1 -- 172.21.15.146:0/3120720284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 msgr2=0x7f53a40cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.158+0000 7f53a3200640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40cc590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5390009910 tx=0x7f53900091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 -- 172.21.15.146:0/3120720284 shutdown_connections 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40cc590 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 --2- 172.21.15.146:0/3120720284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a4159ca0 0x7f53a40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 -- 172.21.15.146:0/3120720284 >> 172.21.15.146:0/3120720284 conn(0x7f53a4098e00 msgr2=0x7f53a406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 -- 172.21.15.146:0/3120720284 shutdown_connections 2024-08-17T02:26:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.159+0000 7f53a3200640 1 -- 172.21.15.146:0/3120720284 wait complete. 2024-08-17T02:26:15.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.160+0000 7f53a3200640 1 Processor -- start 2024-08-17T02:26:15.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.160+0000 7f53a3200640 1 -- start start 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40ccad0 0x7f53a40c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a4159ca0 0x7f53a40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c8bc0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c7fb0 con 0x7f53a4159ca0 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c8290 con 0x7f53a40ccad0 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41726/0 (socket says 172.21.15.146:41726) 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a1e00640 1 -- 172.21.15.146:0/249843348 learned_addr learned my addr 172.21.15.146:0/249843348 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a1400640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40ccad0 0x7f53a40c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.161+0000 7f53a2800640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a4159ca0 0x7f53a40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 -- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40ccad0 msgr2=0x7f53a40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40ccad0 0x7f53a40c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 -- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a4159ca0 msgr2=0x7f53a40c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a4159ca0 0x7f53a40c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 -- 172.21.15.146:0/249843348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009450 con 0x7f53a40ca8a0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a1e00640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f539400e900 tx=0x7f53940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400c8e0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539400ca40 con 0x7f53a40ca8a0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539400cde0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40c8570 con 0x7f53a40ca8a0 2024-08-17T02:26:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.162+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a40c9050 con 0x7f53a40ca8a0 2024-08-17T02:26:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.163+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4071050 con 0x7f53a40ca8a0 2024-08-17T02:26:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.164+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5394013680 con 0x7f53a40ca8a0 2024-08-17T02:26:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.165+0000 7f5399600640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 0x7f5384067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.165+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5394082610 con 0x7f53a40ca8a0 2024-08-17T02:26:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.165+0000 7f53a1400640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 0x7f5384067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.166+0000 7f53a1400640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 0x7f5384067630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5390034000 tx=0x7f5390032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.169+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53940506e0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.379+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53a40691b0 con 0x7f53a40ca8a0 2024-08-17T02:26:15.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.379+0000 7f5399600640 1 -- 172.21.15.146:0/249843348 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f5394053d00 con 0x7f53a40ca8a0 2024-08-17T02:26:15.381 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:15.381 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.381+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 msgr2=0x7f5384067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.381+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 0x7f5384067630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5390034000 tx=0x7f5390032000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.381+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 msgr2=0x7f53a40c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.381+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f539400e900 tx=0x7f53940090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 shutdown_connections 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5384065180 0x7f5384067630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a4159ca0 0x7f53a40c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40ccad0 0x7f53a40c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 --2- 172.21.15.146:0/249843348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53a40ca8a0 0x7f53a40c5a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 >> 172.21.15.146:0/249843348 conn(0x7f53a4098e00 msgr2=0x7f53a40ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 shutdown_connections 2024-08-17T02:26:15.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.382+0000 7f53a3200640 1 -- 172.21.15.146:0/249843348 wait complete. 2024-08-17T02:26:15.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.545+0000 7ff1e8c00640 1 Processor -- start 2024-08-17T02:26:15.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.545+0000 7ff1e8c00640 1 -- start start 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e8c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e4155180 0x7ff1e40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e8c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e8c00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40afc10 con 0x7ff1e4155550 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e8c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e406ea00 con 0x7ff1e4155180 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e8c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40af000 con 0x7ff1e406e080 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e4155180 0x7ff1e40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1e4155180 0x7ff1e40aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41738/0 (socket says 172.21.15.146:41738) 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.546+0000 7ff1e1e00640 1 -- 172.21.15.146:0/1063499714 learned_addr learned my addr 172.21.15.146:0/1063499714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.547+0000 7ff1e2800640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.547+0000 7ff1e1e00640 1 -- 172.21.15.146:0/1063499714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 msgr2=0x7ff1e406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.547+0000 7ff1e1e00640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e406e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.547+0000 7ff1e1e00640 1 -- 172.21.15.146:0/1063499714 >> v1:172.21.15.150:6789/0 conn(0x7ff1e4155550 legacy=0x7ff1e40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.547+0000 7ff1e1e00640 1 -- 172.21.15.146:0/1063499714 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40af2e0 con 0x7ff1e4155180 2024-08-17T02:26:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.548+0000 7ff1e1e00640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e40aea20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400bbf0 tx=0x7ff1d400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eb0f333eba27ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.548+0000 7ff1e1400640 1 -- 172.21.15.146:0/1063499714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4031610 con 0x7ff1e4155180 2024-08-17T02:26:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.548+0000 7ff1e1400640 1 -- 172.21.15.146:0/1063499714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4031770 con 0x7ff1e4155180 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.548+0000 7ff1e1400640 1 -- 172.21.15.146:0/1063499714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4031b50 con 0x7ff1e4155180 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 -- 172.21.15.146:0/1063499714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 msgr2=0x7ff1e40aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e40aea20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400bbf0 tx=0x7ff1d400b460 comp rx=0 tx=0).stop 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 -- 172.21.15.146:0/1063499714 shutdown_connections 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/1063499714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e40aea20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 -- 172.21.15.146:0/1063499714 >> 172.21.15.146:0/1063499714 conn(0x7ff1e40cb9b0 msgr2=0x7ff1e40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 -- 172.21.15.146:0/1063499714 shutdown_connections 2024-08-17T02:26:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.549+0000 7ff1e8c00640 1 -- 172.21.15.146:0/1063499714 wait complete. 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.550+0000 7ff1e8c00640 1 Processor -- start 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.550+0000 7ff1e8c00640 1 -- start start 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e40a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1e4155550 0x7ff1e40a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40a5a10 con 0x7ff1e4155180 2024-08-17T02:26:15.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4164ee0 con 0x7ff1e4155550 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e8c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e41651c0 con 0x7ff1e406e080 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1dbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1dbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41740/0 (socket says 172.21.15.146:41740) 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e1e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e40a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1dbe00640 1 -- 172.21.15.146:0/538691532 learned_addr learned my addr 172.21.15.146:0/538691532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.551+0000 7ff1e2800640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1e4155550 0x7ff1e40a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 -- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 msgr2=0x7ff1e40a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e40a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 -- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1e4155550 msgr2=0x7ff1e40a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1e4155550 0x7ff1e40a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 -- 172.21.15.146:0/538691532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d400b700 con 0x7ff1e4155180 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1dbe00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c490 tx=0x7ff1cc007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc016070 con 0x7ff1e4155180 2024-08-17T02:26:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc007020 con 0x7ff1e4155180 2024-08-17T02:26:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc007420 con 0x7ff1e4155180 2024-08-17T02:26:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e41654a0 con 0x7ff1e4155180 2024-08-17T02:26:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.552+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e414fc80 con 0x7ff1e4155180 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.553+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e414fea0 con 0x7ff1e4155180 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.554+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff1cc0069a0 con 0x7ff1e4155180 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.555+0000 7ff1d9600640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 0x7ff1c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.555+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1cc081b00 con 0x7ff1e4155180 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.555+0000 7ff1e1e00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 0x7ff1c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.556+0000 7ff1e1e00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 0x7ff1c0067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4037000 tx=0x7ff1d403a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.559+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff1cc083e60 con 0x7ff1e4155180 2024-08-17T02:26:15.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.732+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e4064db0 con 0x7ff1e4155180 2024-08-17T02:26:15.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.733+0000 7ff1d9600640 1 -- 172.21.15.146:0/538691532 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff1cc04fbd0 con 0x7ff1e4155180 2024-08-17T02:26:15.735 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:15.735 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 msgr2=0x7ff1c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 0x7ff1c0067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4037000 tx=0x7ff1d403a000 comp rx=0 tx=0).stop 2024-08-17T02:26:15.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 msgr2=0x7ff1e4069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c490 tx=0x7ff1cc007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 shutdown_connections 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1c0065150 0x7ff1c0067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e4155180 0x7ff1e4069c30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1e4155550 0x7ff1e40a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 --2- 172.21.15.146:0/538691532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1e406e080 0x7ff1e40a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 >> 172.21.15.146:0/538691532 conn(0x7ff1e40cb9b0 msgr2=0x7ff1e4150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 shutdown_connections 2024-08-17T02:26:15.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.735+0000 7ff1e8c00640 1 -- 172.21.15.146:0/538691532 wait complete. 2024-08-17T02:26:15.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:15.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:15.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.904+0000 7f9b7ac00640 1 Processor -- start 2024-08-17T02:26:15.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.904+0000 7f9b7ac00640 1 -- start start 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b7ac00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b740accf0 0x7f9b740b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b7ac00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9b740afd90 0x7f9b74157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b7ac00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740ae540 con 0x7f9b74159610 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b7ac00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740ad930 con 0x7f9b740accf0 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b7ac00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740adc10 con 0x7f9b740afd90 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b740accf0 0x7f9b740b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b73400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9b74159610 0x7f9b740af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53072/0 (socket says 172.21.15.146:53072) 2024-08-17T02:26:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b73400640 1 -- 172.21.15.146:0/3653520098 learned_addr learned my addr 172.21.15.146:0/3653520098 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.905+0000 7f9b73e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b740accf0 0x7f9b740b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41744/0 (socket says 172.21.15.146:41744) 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b78c00640 1 --2- 172.21.15.146:0/3653520098 >> v2:172.21.15.150:3300/0 conn(0x7f9b740afd90 0x7f9b74157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b73e00640 1 -- 172.21.15.146:0/3653520098 >> v2:172.21.15.150:3300/0 conn(0x7f9b740afd90 msgr2=0x7f9b74157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b73e00640 1 --2- 172.21.15.146:0/3653520098 >> v2:172.21.15.150:3300/0 conn(0x7f9b740afd90 0x7f9b74157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b73e00640 1 -- 172.21.15.146:0/3653520098 >> v1:172.21.15.146:6789/0 conn(0x7f9b74159610 legacy=0x7f9b740af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b73e00640 1 -- 172.21.15.146:0/3653520098 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740adef0 con 0x7f9b740accf0 2024-08-17T02:26:15.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.906+0000 7f9b72a00640 1 -- 172.21.15.146:0/3653520098 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175763034 0 0) 0x7f9b740ae540 con 0x7f9b74159610 2024-08-17T02:26:15.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.907+0000 7f9b73e00640 1 --2- 172.21.15.146:0/3653520098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740accf0 0x7f9b740b1670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b74159a90 tx=0x7f9b640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d4bda2ca8afe4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.907+0000 7f9b72a00640 1 -- 172.21.15.146:0/3653520098 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64031510 con 0x7f9b740accf0 2024-08-17T02:26:15.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.907+0000 7f9b72a00640 1 -- 172.21.15.146:0/3653520098 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6402f050 con 0x7f9b740accf0 2024-08-17T02:26:15.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.907+0000 7f9b72a00640 1 -- 172.21.15.146:0/3653520098 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640318a0 con 0x7f9b740accf0 2024-08-17T02:26:15.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 -- 172.21.15.146:0/3653520098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740accf0 msgr2=0x7f9b740b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/3653520098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740accf0 0x7f9b740b1670 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b74159a90 tx=0x7f9b640090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 -- 172.21.15.146:0/3653520098 shutdown_connections 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/3653520098 >> v2:172.21.15.150:3300/0 conn(0x7f9b740afd90 0x7f9b74157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/3653520098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740accf0 0x7f9b740b1670 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 -- 172.21.15.146:0/3653520098 >> 172.21.15.146:0/3653520098 conn(0x7f9b74067750 msgr2=0x7f9b740cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 -- 172.21.15.146:0/3653520098 shutdown_connections 2024-08-17T02:26:15.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.908+0000 7f9b7ac00640 1 -- 172.21.15.146:0/3653520098 wait complete. 2024-08-17T02:26:15.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.909+0000 7f9b7ac00640 1 Processor -- start 2024-08-17T02:26:15.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.909+0000 7f9b7ac00640 1 -- start start 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b740accf0 0x7f9b74168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b74159610 0x7f9b7416a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7416b660 con 0x7f9b740afd90 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7416aa50 con 0x7f9b740accf0 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b7ac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7416ad30 con 0x7f9b74159610 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.910+0000 7f9b73400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41756/0 (socket says 172.21.15.146:41756) 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 -- 172.21.15.146:0/1969289670 learned_addr learned my addr 172.21.15.146:0/1969289670 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73e00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b740accf0 0x7f9b74168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b78c00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b74159610 0x7f9b7416a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 -- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b74159610 msgr2=0x7f9b7416a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b74159610 0x7f9b7416a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 -- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b740accf0 msgr2=0x7f9b74168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b740accf0 0x7f9b74168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 -- 172.21.15.146:0/1969289670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64009390 con 0x7f9b740afd90 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b73400640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000c510 tx=0x7f9b6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60005aa0 con 0x7f9b740afd90 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b60005c00 con 0x7f9b740afd90 2024-08-17T02:26:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b600070d0 con 0x7f9b740afd90 2024-08-17T02:26:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.911+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7416b010 con 0x7f9b740afd90 2024-08-17T02:26:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.912+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b740cabf0 con 0x7f9b740afd90 2024-08-17T02:26:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.913+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7416b810 con 0x7f9b740afd90 2024-08-17T02:26:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.913+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b60007500 con 0x7f9b740afd90 2024-08-17T02:26:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.914+0000 7f9b6b400640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 0x7f9b54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.915+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b60081970 con 0x7f9b740afd90 2024-08-17T02:26:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.915+0000 7f9b73e00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 0x7f9b54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.915+0000 7f9b73e00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 0x7f9b54067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b64036000 tx=0x7f9b64037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:15.918+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9b7416b810 con 0x7f9b740afd90 2024-08-17T02:26:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.090+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b74064db0 con 0x7f9b740afd90 2024-08-17T02:26:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.090+0000 7f9b6b400640 1 -- 172.21.15.146:0/1969289670 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b600170a0 con 0x7f9b740afd90 2024-08-17T02:26:16.092 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.092+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 msgr2=0x7f9b54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.092+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 0x7f9b54067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b64036000 tx=0x7f9b64037000 comp rx=0 tx=0).stop 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.092+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 msgr2=0x7f9b740ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.092+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000c510 tx=0x7f9b6000c910 comp rx=0 tx=0).stop 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 shutdown_connections 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9b54065150 0x7f9b54067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b740afd90 0x7f9b740ca6b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9b74159610 0x7f9b7416a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 --2- 172.21.15.146:0/1969289670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b740accf0 0x7f9b74168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 >> 172.21.15.146:0/1969289670 conn(0x7f9b74067750 msgr2=0x7f9b74158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 shutdown_connections 2024-08-17T02:26:16.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.093+0000 7f9b7ac00640 1 -- 172.21.15.146:0/1969289670 wait complete. 2024-08-17T02:26:16.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.259+0000 7f12ad000640 1 Processor -- start 2024-08-17T02:26:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.259+0000 7f12ad000640 1 -- start start 2024-08-17T02:26:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12ad000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12a815c2f0 0x7f12a80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12ad000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80af910 con 0x7f12a80b0f20 2024-08-17T02:26:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12ad000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80afbb0 con 0x7f12a80d0890 2024-08-17T02:26:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12ad000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80b1e10 con 0x7f12a815c2f0 2024-08-17T02:26:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12a5e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12a815c2f0 0x7f12a80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12a6800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12a80b0f20 0x7f12a80b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53076/0 (socket says 172.21.15.146:53076) 2024-08-17T02:26:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.260+0000 7f12a6800640 1 -- 172.21.15.146:0/2180910013 learned_addr learned my addr 172.21.15.146:0/2180910013 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.261+0000 7f12a5e00640 1 -- 172.21.15.146:0/2180910013 >> v1:172.21.15.150:6789/0 conn(0x7f12a80d0890 legacy=0x7f12a80b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.261+0000 7f12a5e00640 1 -- 172.21.15.146:0/2180910013 >> v1:172.21.15.146:6789/0 conn(0x7f12a80b0f20 legacy=0x7f12a80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.261+0000 7f12a5e00640 1 -- 172.21.15.146:0/2180910013 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80afe90 con 0x7f12a815c2f0 2024-08-17T02:26:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.261+0000 7f12a4a00640 1 -- 172.21.15.146:0/2180910013 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14199993 0 0) 0x7f12a80af910 con 0x7f12a80b0f20 2024-08-17T02:26:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.262+0000 7f12a5e00640 1 --2- 172.21.15.146:0/2180910013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a815c2f0 0x7f12a80af3d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1298009850 tx=0x7f12980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eaea1d2db4d870 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.262+0000 7f12a4a00640 1 -- 172.21.15.146:0/2180910013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129802adb0 con 0x7f12a815c2f0 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.262+0000 7f12a4a00640 1 -- 172.21.15.146:0/2180910013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1298032440 con 0x7f12a815c2f0 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.262+0000 7f12a4a00640 1 -- 172.21.15.146:0/2180910013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12980327e0 con 0x7f12a815c2f0 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 -- 172.21.15.146:0/2180910013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a815c2f0 msgr2=0x7f12a80af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 --2- 172.21.15.146:0/2180910013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a815c2f0 0x7f12a80af3d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1298009850 tx=0x7f12980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 -- 172.21.15.146:0/2180910013 shutdown_connections 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 --2- 172.21.15.146:0/2180910013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a815c2f0 0x7f12a80af3d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 -- 172.21.15.146:0/2180910013 >> 172.21.15.146:0/2180910013 conn(0x7f12a80cfdb0 msgr2=0x7f12a80d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 -- 172.21.15.146:0/2180910013 shutdown_connections 2024-08-17T02:26:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.263+0000 7f12ad000640 1 -- 172.21.15.146:0/2180910013 wait complete. 2024-08-17T02:26:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.264+0000 7f12ad000640 1 Processor -- start 2024-08-17T02:26:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.264+0000 7f12ad000640 1 -- start start 2024-08-17T02:26:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 0x7f12a816cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 0x7f12a80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a816d4b0 con 0x7f12a80d0890 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8150220 con 0x7f12a80b0f20 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12ad000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8150470 con 0x7f12a815c2f0 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41786/0 (socket says 172.21.15.146:41786) 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.265+0000 7f12a5400640 1 -- 172.21.15.146:0/454851506 learned_addr learned my addr 172.21.15.146:0/454851506 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a6800640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 0x7f12a80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5e00640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 0x7f12a816cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 -- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 msgr2=0x7f12a80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 0x7f12a80aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 -- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 msgr2=0x7f12a816cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 0x7f12a816cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 -- 172.21.15.146:0/454851506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298009390 con 0x7f12a80d0890 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a6800640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 0x7f12a80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5e00640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 0x7f12a816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12a5400640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f129400c5e0 tx=0x7f1294007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294012630 con 0x7f12a80d0890 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12940127b0 con 0x7f12a80d0890 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294012bb0 con 0x7f12a80d0890 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8150750 con 0x7f12a80d0890 2024-08-17T02:26:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.266+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8150d10 con 0x7f12a80d0890 2024-08-17T02:26:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.268+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a8071050 con 0x7f12a80d0890 2024-08-17T02:26:16.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.268+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f129401b400 con 0x7f12a80d0890 2024-08-17T02:26:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.270+0000 7f129d600640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 0x7f1288067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.270+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1294082690 con 0x7f12a80d0890 2024-08-17T02:26:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.270+0000 7f12a5e00640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 0x7f1288067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.271+0000 7f12a5e00640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 0x7f1288067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f1298032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.274+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1294050770 con 0x7f12a80d0890 2024-08-17T02:26:16.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.445+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12a80899a0 con 0x7f12a80d0890 2024-08-17T02:26:16.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.445+0000 7f129d600640 1 -- 172.21.15.146:0/454851506 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1294016020 con 0x7f12a80d0890 2024-08-17T02:26:16.447 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 msgr2=0x7f1288067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 0x7f1288067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1298034000 tx=0x7f1298032000 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 msgr2=0x7f12a814efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f129400c5e0 tx=0x7f1294007ed0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 shutdown_connections 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1288065150 0x7f1288067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a80d0890 0x7f12a814efe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f12a815c2f0 0x7f12a80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 --2- 172.21.15.146:0/454851506 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12a80b0f20 0x7f12a816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 >> 172.21.15.146:0/454851506 conn(0x7f12a80cfdb0 msgr2=0x7f12a80b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 shutdown_connections 2024-08-17T02:26:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.447+0000 7f12ad000640 1 -- 172.21.15.146:0/454851506 wait complete. 2024-08-17T02:26:16.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:16.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.612+0000 7f9d9be00640 1 Processor -- start 2024-08-17T02:26:16.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.612+0000 7f9d9be00640 1 -- start start 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9be00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9d9c0caa80 0x7f9d9c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c156e60 con 0x7f9d9c0abef0 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9be00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c0c95e0 con 0x7f9d9c0ad3e0 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9be00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0ac2c0 con 0x7f9d9c0caa80 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9d9c0abef0 0x7f9d9c0accd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53086/0 (socket says 172.21.15.146:53086) 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9aa00640 1 -- 172.21.15.146:0/282688205 learned_addr learned my addr 172.21.15.146:0/282688205 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9b400640 1 --2- 172.21.15.146:0/282688205 >> v2:172.21.15.150:3300/0 conn(0x7f9d9c0caa80 0x7f9d9c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610483901 0 0) 0x7f9d9c156e60 con 0x7f9d9c0abef0 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d800034e0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469328147 0 0) 0x7f9d9c0c95e0 con 0x7f9d9c0ad3e0 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d9c156e60 con 0x7f9d9c0ad3e0 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9b400640 1 -- 172.21.15.146:0/282688205 >> v1:172.21.15.150:6789/0 conn(0x7f9d9c0ad3e0 legacy=0x7f9d9c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9b400640 1 -- 172.21.15.146:0/282688205 >> v1:172.21.15.146:6789/0 conn(0x7f9d9c0abef0 legacy=0x7f9d9c0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.614+0000 7f9d9b400640 1 -- 172.21.15.146:0/282688205 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c06e100 con 0x7f9d9c0caa80 2024-08-17T02:26:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.615+0000 7f9d9b400640 1 --2- 172.21.15.146:0/282688205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0caa80 0x7f9d9c06db00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009e60 tx=0x7f9d94009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beda20e749e6ca60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94007550 con 0x7f9d9c0caa80 2024-08-17T02:26:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9402d050 con 0x7f9d9c0caa80 2024-08-17T02:26:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9a000640 1 -- 172.21.15.146:0/282688205 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94007900 con 0x7f9d9c0caa80 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 -- 172.21.15.146:0/282688205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0caa80 msgr2=0x7f9d9c06db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 --2- 172.21.15.146:0/282688205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0caa80 0x7f9d9c06db00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009e60 tx=0x7f9d94009780 comp rx=0 tx=0).stop 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 -- 172.21.15.146:0/282688205 shutdown_connections 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 --2- 172.21.15.146:0/282688205 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0caa80 0x7f9d9c06db00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 -- 172.21.15.146:0/282688205 >> 172.21.15.146:0/282688205 conn(0x7f9d9c066cd0 msgr2=0x7f9d9c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 -- 172.21.15.146:0/282688205 shutdown_connections 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.616+0000 7f9d9be00640 1 -- 172.21.15.146:0/282688205 wait complete. 2024-08-17T02:26:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.618+0000 7f9d9be00640 1 Processor -- start 2024-08-17T02:26:16.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.618+0000 7f9d9be00640 1 -- start start 2024-08-17T02:26:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0ad3e0 0x7f9d9c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d9c0caa80 0x7f9d9c15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c15eb60 con 0x7f9d9c0abef0 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c15df50 con 0x7f9d9c0ad3e0 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c15e230 con 0x7f9d9c0caa80 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41800/0 (socket says 172.21.15.146:41800) 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 -- 172.21.15.146:0/3669083111 learned_addr learned my addr 172.21.15.146:0/3669083111 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d93e00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0ad3e0 0x7f9d9c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9b400640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d9c0caa80 0x7f9d9c15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 -- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d9c0caa80 msgr2=0x7f9d9c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d9c0caa80 0x7f9d9c15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 -- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0ad3e0 msgr2=0x7f9d9c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0ad3e0 0x7f9d9c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.619+0000 7f9d9aa00640 1 -- 172.21.15.146:0/3669083111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94009a20 con 0x7f9d9c0abef0 2024-08-17T02:26:16.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d9aa00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c005840 tx=0x7f9d8c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c005aa0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c005c00 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c15e510 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0070f0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.620+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c1517c0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.621+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c071050 con 0x7f9d9c0abef0 2024-08-17T02:26:16.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.622+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d8c007520 con 0x7f9d9c0abef0 2024-08-17T02:26:16.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.622+0000 7f9d92000640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 0x7f9d78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.623+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d8c081e30 con 0x7f9d9c0abef0 2024-08-17T02:26:16.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.623+0000 7f9d93e00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 0x7f9d78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.623+0000 7f9d93e00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 0x7f9d78067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c15f9b0 tx=0x7f9d84007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.626+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9d8c04ff80 con 0x7f9d9c0abef0 2024-08-17T02:26:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.799+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d9c15a2d0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.799+0000 7f9d92000640 1 -- 172.21.15.146:0/3669083111 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d8c0535a0 con 0x7f9d9c0abef0 2024-08-17T02:26:16.801 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.801+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 msgr2=0x7f9d78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.801+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 0x7f9d78067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c15f9b0 tx=0x7f9d84007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.801+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 msgr2=0x7f9d9c157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.801+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c005840 tx=0x7f9d8c007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 shutdown_connections 2024-08-17T02:26:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9d78065150 0x7f9d78067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9d9c0caa80 0x7f9d9c15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9d9c0ad3e0 0x7f9d9c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 --2- 172.21.15.146:0/3669083111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9c0abef0 0x7f9d9c157b70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 >> 172.21.15.146:0/3669083111 conn(0x7f9d9c066cd0 msgr2=0x7f9d9c068920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 shutdown_connections 2024-08-17T02:26:16.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.802+0000 7f9d9be00640 1 -- 172.21.15.146:0/3669083111 wait complete. 2024-08-17T02:26:16.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.963+0000 7f5341000640 1 Processor -- start 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.963+0000 7f5341000640 1 -- start start 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5341000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f533c06df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5341000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c0afc10 con 0x7f533c155180 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5341000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c0af000 con 0x7f533c0aea20 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5341000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0aedf0 con 0x7f533c155600 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5339400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f533c155180 0x7f533c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53090/0 (socket says 172.21.15.146:53090) 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5339400640 1 -- 172.21.15.146:0/436053239 learned_addr learned my addr 172.21.15.146:0/436053239 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f533a800640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f533c06df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827754637 0 0) 0x7f533c0afc10 con 0x7f533c155180 2024-08-17T02:26:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53200034e0 con 0x7f533c155180 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163314645 0 0) 0x7f533c0af000 con 0x7f533c0aea20 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f533c0afc10 con 0x7f533c0aea20 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.965+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2296306983 0 0) 0x7f53200034e0 con 0x7f533c155180 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 msgr2=0x7f533c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f533c06df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 >> v1:172.21.15.150:6789/0 conn(0x7f533c0aea20 legacy=0x7f533c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0af2e0 con 0x7f533c155180 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f5328001490 con 0x7f533c155180 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 >> v1:172.21.15.146:6789/0 conn(0x7f533c155180 legacy=0x7f533c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5320003b90 0x7f5320003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f5320004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5320004cc0 0x7f5320005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0aedf0 con 0x7f5320003b90 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532000bb60 con 0x7f5320004cc0 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532000bd20 con 0x7f533c155600 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5320003b90 0x7f5320003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339400640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f5320004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f533a800640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5320004cc0 0x7f5320005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 -- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 msgr2=0x7f5320004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f533c155600 0x7f5320004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 -- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5320004cc0 msgr2=0x7f5320005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5320004cc0 0x7f5320005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.966+0000 7f5339e00640 1 -- 172.21.15.146:0/436053239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200034e0 con 0x7f5320003b90 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.967+0000 7f5339e00640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5320003b90 0x7f5320003f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c007fd0 tx=0x7f532c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c42b4af6dbeb9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c02aa40 con 0x7f5320003b90 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c02aba0 con 0x7f5320003b90 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5338a00640 1 -- 172.21.15.146:0/436053239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0323f0 con 0x7f5320003b90 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 -- 172.21.15.146:0/436053239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5320003b90 msgr2=0x7f5320003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 --2- 172.21.15.146:0/436053239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5320003b90 0x7f5320003f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c007fd0 tx=0x7f532c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f533a800640 1 -- 172.21.15.146:0/436053239 reap_dead start 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 -- 172.21.15.146:0/436053239 shutdown_connections 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 -- 172.21.15.146:0/436053239 >> 172.21.15.146:0/436053239 conn(0x7f533c0cb9b0 msgr2=0x7f533c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 -- 172.21.15.146:0/436053239 shutdown_connections 2024-08-17T02:26:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.968+0000 7f5341000640 1 -- 172.21.15.146:0/436053239 wait complete. 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.970+0000 7f5341000640 1 Processor -- start 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.970+0000 7f5341000640 1 -- start start 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 0x7f533c0a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 0x7f533c14f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c14fec0 con 0x7f533c0c9a10 2024-08-17T02:26:16.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0a6610 con 0x7f533c0c9e80 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5341000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0a5ce0 con 0x7f5320003b90 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41816/0 (socket says 172.21.15.146:41816) 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 -- 172.21.15.146:0/699894223 learned_addr learned my addr 172.21.15.146:0/699894223 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339e00640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 0x7f533c0a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f533a800640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 0x7f533c14f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 -- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 msgr2=0x7f533c0a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 0x7f533c0a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 -- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 msgr2=0x7f533c14f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 0x7f533c14f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339400640 1 -- 172.21.15.146:0/699894223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0a5fc0 con 0x7f533c0c9a10 2024-08-17T02:26:16.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f5339e00640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 0x7f533c0a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.971+0000 7f533a800640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 0x7f533c14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5339400640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5328000ff0 tx=0x7f5328009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328005aa0 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328005c00 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c0a62a0 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280070d0 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.972+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c155f00 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.973+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c064db0 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.974+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5328007480 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.975+0000 7f5331600640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 0x7f531c067620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.975+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5328082090 con 0x7f533c0c9a10 2024-08-17T02:26:16.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.975+0000 7f5339e00640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 0x7f531c067620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.975+0000 7f5339e00640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 0x7f531c067620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f532c032000 tx=0x7f532c003000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:16.978+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53280500b0 con 0x7f533c0c9a10 2024-08-17T02:26:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.187+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f533c068ea0 con 0x7f533c0c9a10 2024-08-17T02:26:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.188+0000 7f5331600640 1 -- 172.21.15.146:0/699894223 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f53280536d0 con 0x7f533c0c9a10 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 msgr2=0x7f531c067620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 0x7f531c067620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f532c032000 tx=0x7f532c003000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 msgr2=0x7f533c14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5328000ff0 tx=0x7f5328009040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 shutdown_connections 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f531c065170 0x7f531c067620 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0c9a10 0x7f533c14f440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f533c0c9e80 0x7f533c14f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 --2- 172.21.15.146:0/699894223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5320003b90 0x7f533c0a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 >> 172.21.15.146:0/699894223 conn(0x7f533c0cb9b0 msgr2=0x7f533c1526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 shutdown_connections 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.190+0000 7f5341000640 1 -- 172.21.15.146:0/699894223 wait complete. 2024-08-17T02:26:17.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.354+0000 7fb8dce00640 1 Processor -- start 2024-08-17T02:26:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.354+0000 7fb8dce00640 1 -- start start 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 0x7fb8d80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d8140580 0x7fb8d80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8d80b1270 0x7fb8d80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d80cb450 con 0x7fb8d80b1270 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d80b16d0 con 0x7fb8d81401b0 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.355+0000 7fb8dce00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80caa80 con 0x7fb8d8140580 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8d80b1270 0x7fb8d80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8d80b1270 0x7fb8d80c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41832/0 (socket says 172.21.15.146:41832) 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 -- 172.21.15.146:0/3094568025 learned_addr learned my addr 172.21.15.146:0/3094568025 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d5400640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d8140580 0x7fb8d80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d5e00640 1 --2- 172.21.15.146:0/3094568025 >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 0x7fb8d80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 -- 172.21.15.146:0/3094568025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d8140580 msgr2=0x7fb8d80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d8140580 0x7fb8d80b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 -- 172.21.15.146:0/3094568025 >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 msgr2=0x7fb8d80caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3094568025 >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 0x7fb8d80caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d6800640 1 -- 172.21.15.146:0/3094568025 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d80c9e70 con 0x7fb8d80b1270 2024-08-17T02:26:17.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.356+0000 7fb8d5e00640 1 --2- 172.21.15.146:0/3094568025 >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 0x7fb8d80caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.357+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80b1270 0x7fb8d80c9040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8068650 tx=0x7fb8d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e4f6671c47b306 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.357+0000 7fb8d4a00640 1 -- 172.21.15.146:0/3094568025 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0031400 con 0x7fb8d80b1270 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.357+0000 7fb8d4a00640 1 -- 172.21.15.146:0/3094568025 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d002d050 con 0x7fb8d80b1270 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.357+0000 7fb8d4a00640 1 -- 172.21.15.146:0/3094568025 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00317d0 con 0x7fb8d80b1270 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 -- 172.21.15.146:0/3094568025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80b1270 msgr2=0x7fb8d80c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80b1270 0x7fb8d80c9040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8068650 tx=0x7fb8d0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 -- 172.21.15.146:0/3094568025 shutdown_connections 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80b1270 0x7fb8d80c9040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3094568025 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d8140580 0x7fb8d80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3094568025 >> v2:172.21.15.150:3300/0 conn(0x7fb8d81401b0 0x7fb8d80caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 -- 172.21.15.146:0/3094568025 >> 172.21.15.146:0/3094568025 conn(0x7fb8d80cb9b0 msgr2=0x7fb8d80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 -- 172.21.15.146:0/3094568025 shutdown_connections 2024-08-17T02:26:17.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.358+0000 7fb8dce00640 1 -- 172.21.15.146:0/3094568025 wait complete. 2024-08-17T02:26:17.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.359+0000 7fb8dce00640 1 Processor -- start 2024-08-17T02:26:17.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.360+0000 7fb8dce00640 1 -- start start 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.360+0000 7fb8dce00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d80b1270 0x7fb8d80c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.360+0000 7fb8dce00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8d81401b0 0x7fb8d8069760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8dce00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8dce00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c4fe0 con 0x7fb8d8140580 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8dce00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c43d0 con 0x7fb8d81401b0 2024-08-17T02:26:17.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8dce00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c46b0 con 0x7fb8d80b1270 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41844/0 (socket says 172.21.15.146:41844) 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 -- 172.21.15.146:0/3210246440 learned_addr learned my addr 172.21.15.146:0/3210246440 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d5e00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d80b1270 0x7fb8d80c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d5400640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8d81401b0 0x7fb8d8069760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 -- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d80b1270 msgr2=0x7fb8d80c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d80b1270 0x7fb8d80c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 -- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8d81401b0 msgr2=0x7fb8d8069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8d81401b0 0x7fb8d8069760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.361+0000 7fb8d6800640 1 -- 172.21.15.146:0/3210246440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d0009ae0 con 0x7fb8d8140580 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8d6800640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8d002ac40 tx=0x7fb8d0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0007170 con 0x7fb8d8140580 2024-08-17T02:26:17.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0008e50 con 0x7fb8d8140580 2024-08-17T02:26:17.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d003b660 con 0x7fb8d8140580 2024-08-17T02:26:17.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d80c4990 con 0x7fb8d8140580 2024-08-17T02:26:17.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.362+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d80c59b0 con 0x7fb8d8140580 2024-08-17T02:26:17.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.363+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d8064db0 con 0x7fb8d8140580 2024-08-17T02:26:17.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.364+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb8d0038050 con 0x7fb8d8140580 2024-08-17T02:26:17.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.365+0000 7fb8cd600640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 0x7fb8b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.365+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8d00a29c0 con 0x7fb8d8140580 2024-08-17T02:26:17.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.365+0000 7fb8d5e00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 0x7fb8b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.366+0000 7fb8d5e00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 0x7fb8b8067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8d813ee60 tx=0x7fb8c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.369+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb8d0070a90 con 0x7fb8d8140580 2024-08-17T02:26:17.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.541+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8d806a390 con 0x7fb8d8140580 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.542+0000 7fb8cd600640 1 -- 172.21.15.146:0/3210246440 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb8d00740b0 con 0x7fb8d8140580 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:17.543 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 msgr2=0x7fb8b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 0x7fb8b8067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8d813ee60 tx=0x7fb8c8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 msgr2=0x7fb8d80c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8d002ac40 tx=0x7fb8d0036000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 shutdown_connections 2024-08-17T02:26:17.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb8b8065150 0x7fb8b8067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d8140580 0x7fb8d80c6010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8d81401b0 0x7fb8d8069760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 --2- 172.21.15.146:0/3210246440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8d80b1270 0x7fb8d80c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 >> 172.21.15.146:0/3210246440 conn(0x7fb8d80cb9b0 msgr2=0x7fb8d806dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.544+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 shutdown_connections 2024-08-17T02:26:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.545+0000 7fb8dce00640 1 -- 172.21.15.146:0/3210246440 wait complete. 2024-08-17T02:26:17.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.708+0000 7fc219200640 1 Processor -- start 2024-08-17T02:26:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.708+0000 7fc219200640 1 -- start start 2024-08-17T02:26:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.709+0000 7fc219200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 0x7fc2140adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.709+0000 7fc219200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc214156670 con 0x7fc214155df0 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.709+0000 7fc219200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21406e5e0 con 0x7fc21406df00 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.709+0000 7fc219200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140b0350 con 0x7fc214155a20 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc214155df0 0x7fc21406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53104/0 (socket says 172.21.15.146:53104) 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211400640 1 -- 172.21.15.146:0/3057566349 learned_addr learned my addr 172.21.15.146:0/3057566349 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211e00640 1 --2- 172.21.15.146:0/3057566349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 0x7fc2140adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717786388 0 0) 0x7fc214156670 con 0x7fc214155df0 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f80034e0 con 0x7fc214155df0 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019585038 0 0) 0x7fc21406e5e0 con 0x7fc21406df00 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc214156670 con 0x7fc21406df00 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211e00640 1 -- 172.21.15.146:0/3057566349 >> v1:172.21.15.150:6789/0 conn(0x7fc21406df00 legacy=0x7fc214156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211e00640 1 -- 172.21.15.146:0/3057566349 >> v1:172.21.15.146:6789/0 conn(0x7fc214155df0 legacy=0x7fc21406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.710+0000 7fc211e00640 1 -- 172.21.15.146:0/3057566349 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21406e8c0 con 0x7fc214155a20 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.711+0000 7fc211e00640 1 --2- 172.21.15.146:0/3057566349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 0x7fc2140adf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc204009880 tx=0x7fc2040090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16388d055c83f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20402ae10 con 0x7fc214155a20 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc204032440 con 0x7fc214155a20 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc210a00640 1 -- 172.21.15.146:0/3057566349 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2040327c0 con 0x7fc214155a20 2024-08-17T02:26:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 -- 172.21.15.146:0/3057566349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 msgr2=0x7fc2140adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 --2- 172.21.15.146:0/3057566349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 0x7fc2140adf10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc204009880 tx=0x7fc2040090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 -- 172.21.15.146:0/3057566349 shutdown_connections 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 --2- 172.21.15.146:0/3057566349 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155a20 0x7fc2140adf10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 -- 172.21.15.146:0/3057566349 >> 172.21.15.146:0/3057566349 conn(0x7fc2140cb9b0 msgr2=0x7fc2140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 -- 172.21.15.146:0/3057566349 shutdown_connections 2024-08-17T02:26:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.712+0000 7fc219200640 1 -- 172.21.15.146:0/3057566349 wait complete. 2024-08-17T02:26:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.714+0000 7fc219200640 1 Processor -- start 2024-08-17T02:26:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.714+0000 7fc219200640 1 -- start start 2024-08-17T02:26:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.714+0000 7fc219200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21406df00 0x7fc21413ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.714+0000 7fc219200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc219200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155df0 0x7fc214168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc219200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2140ade30 con 0x7fc214155a20 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc219200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141404c0 con 0x7fc21406df00 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc219200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21406a120 con 0x7fc214155df0 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41854/0 (socket says 172.21.15.146:41854) 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21406df00 0x7fc21413ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 -- 172.21.15.146:0/2363741365 learned_addr learned my addr 172.21.15.146:0/2363741365 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc212800640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155df0 0x7fc214168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 -- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155df0 msgr2=0x7fc214168f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155df0 0x7fc214168f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 -- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21406df00 msgr2=0x7fc21413ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21406df00 0x7fc21413ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 -- 172.21.15.146:0/2363741365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204009390 con 0x7fc214155a20 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.715+0000 7fc211400640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c580 tx=0x7fc200007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.716+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200005aa0 con 0x7fc214155a20 2024-08-17T02:26:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.716+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200005c00 con 0x7fc214155a20 2024-08-17T02:26:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.716+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2000070f0 con 0x7fc214155a20 2024-08-17T02:26:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.716+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2140690e0 con 0x7fc214155a20 2024-08-17T02:26:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.716+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2140693e0 con 0x7fc214155a20 2024-08-17T02:26:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.717+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc214064db0 con 0x7fc214155a20 2024-08-17T02:26:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.717+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc2000074a0 con 0x7fc214155a20 2024-08-17T02:26:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.718+0000 7fc209600640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 0x7fc1f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.718+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc200081dc0 con 0x7fc214155a20 2024-08-17T02:26:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.719+0000 7fc211e00640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 0x7fc1f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.719+0000 7fc211e00640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 0x7fc1f4067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc204032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.722+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc20004ff10 con 0x7fc214155a20 2024-08-17T02:26:17.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.931+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc214154e50 con 0x7fc214155a20 2024-08-17T02:26:17.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.932+0000 7fc209600640 1 -- 172.21.15.146:0/2363741365 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7fc200053530 con 0x7fc214155a20 2024-08-17T02:26:17.934 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:17.934 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:17.934 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:17.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 msgr2=0x7fc1f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 0x7fc1f4067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc204032000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 msgr2=0x7fc2140ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c580 tx=0x7fc200007e10 comp rx=0 tx=0).stop 2024-08-17T02:26:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 shutdown_connections 2024-08-17T02:26:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc1f4065150 0x7fc1f4067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc214155a20 0x7fc2140ad650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc214155df0 0x7fc214168f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 --2- 172.21.15.146:0/2363741365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc21406df00 0x7fc21413ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 >> 172.21.15.146:0/2363741365 conn(0x7fc2140cb9b0 msgr2=0x7fc214158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 shutdown_connections 2024-08-17T02:26:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:17.934+0000 7fc219200640 1 -- 172.21.15.146:0/2363741365 wait complete. 2024-08-17T02:26:18.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:03.077692+0000', 'modified': '2024-08-17T02:26:06.695058+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/3496457616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 3496457616}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 3496457616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:18.355 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:18.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:26:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.504+0000 7f40d2400640 1 Processor -- start 2024-08-17T02:26:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.504+0000 7f40d2400640 1 -- start start 2024-08-17T02:26:18.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d2400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d2400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40cc06dc80 0x7f40cc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d2400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0caaf0 con 0x7f40cc156ea0 2024-08-17T02:26:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d2400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc0ca900 con 0x7f40cc06dc80 2024-08-17T02:26:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d2400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0cc560 con 0x7f40cc156ad0 2024-08-17T02:26:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d1a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40cc06dc80 0x7f40cc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d1a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40cc06dc80 0x7f40cc1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41856/0 (socket says 172.21.15.146:41856) 2024-08-17T02:26:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.505+0000 7f40d1a00640 1 -- 172.21.15.146:0/1610819286 learned_addr learned my addr 172.21.15.146:0/1610819286 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1000640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1a00640 1 -- 172.21.15.146:0/1610819286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 msgr2=0x7f40cc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1a00640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1a00640 1 -- 172.21.15.146:0/1610819286 >> v1:172.21.15.150:6789/0 conn(0x7f40cc156ea0 legacy=0x7f40cc06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1a00640 1 -- 172.21.15.146:0/1610819286 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0cad90 con 0x7f40cc06dc80 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.506+0000 7f40d1000640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40d1a00640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06dc80 0x7f40cc1577f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009f50 tx=0x7f40c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a3e4fc1790de6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40cb400640 1 -- 172.21.15.146:0/1610819286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007400 con 0x7f40cc06dc80 2024-08-17T02:26:18.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40cb400640 1 -- 172.21.15.146:0/1610819286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4007560 con 0x7f40cc06dc80 2024-08-17T02:26:18.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40cb400640 1 -- 172.21.15.146:0/1610819286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007900 con 0x7f40cc06dc80 2024-08-17T02:26:18.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40d2400640 1 -- 172.21.15.146:0/1610819286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06dc80 msgr2=0x7f40cc1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.507+0000 7f40d2400640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06dc80 0x7f40cc1577f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009f50 tx=0x7f40c4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:18.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 -- 172.21.15.146:0/1610819286 shutdown_connections 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc06dc80 0x7f40cc1577f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 --2- 172.21.15.146:0/1610819286 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 -- 172.21.15.146:0/1610819286 >> 172.21.15.146:0/1610819286 conn(0x7f40cc067750 msgr2=0x7f40cc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 -- 172.21.15.146:0/1610819286 shutdown_connections 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.508+0000 7f40d2400640 1 -- 172.21.15.146:0/1610819286 wait complete. 2024-08-17T02:26:18.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.509+0000 7f40d2400640 1 Processor -- start 2024-08-17T02:26:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.509+0000 7f40d2400640 1 -- start start 2024-08-17T02:26:18.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40cc06dc80 0x7f40cc0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0aecf0 con 0x7f40cc156ea0 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc16d210 con 0x7f40cc06dc80 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d2400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc16c690 con 0x7f40cc156ad0 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41872/0 (socket says 172.21.15.146:41872) 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d1a00640 1 -- 172.21.15.146:0/2388051866 learned_addr learned my addr 172.21.15.146:0/2388051866 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40d1000640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40cc06dc80 0x7f40cc0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.510+0000 7f40cbe00640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 -- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 msgr2=0x7f40cc14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 -- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40cc06dc80 msgr2=0x7f40cc0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40cc06dc80 0x7f40cc0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 -- 172.21.15.146:0/2388051866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009ae0 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009f50 tx=0x7f40c4034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40bfe00640 1 -- 172.21.15.146:0/2388051866 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4032e50 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40bfe00640 1 -- 172.21.15.146:0/2388051866 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c403d430 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc16c970 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40bfe00640 1 -- 172.21.15.146:0/2388051866 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c403d7d0 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.511+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc16cf30 con 0x7f40cc156ea0 2024-08-17T02:26:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.513+0000 7f40bfe00640 1 -- 172.21.15.146:0/2388051866 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40c403dbc0 con 0x7f40cc156ea0 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.514+0000 7f40bfe00640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 0x7f40ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.515+0000 7f40bfe00640 1 -- 172.21.15.146:0/2388051866 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40c40a3b50 con 0x7f40cc156ea0 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.515+0000 7f40d1000640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 0x7f40ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.515+0000 7f40d5fd6740 1 Processor -- start 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.515+0000 7f40d1000640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 0x7f40ac067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40c000acc0 tx=0x7f40c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.515+0000 7f40d5fd6740 1 -- start start 2024-08-17T02:26:18.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388200f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b3881d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b388196380 con 0x55b3881dc230 2024-08-17T02:26:18.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b38813f9e0 con 0x55b388200bc0 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b38813d170 con 0x55b38821eca0 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41876/0 (socket says 172.21.15.146:41876) 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40cbe00640 1 -- 172.21.15.146:0/3122984804 learned_addr learned my addr 172.21.15.146:0/3122984804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d1000640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388200f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.516+0000 7f40d1a00640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b3881d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 -- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 msgr2=0x55b3881d5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b3881d5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 -- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 msgr2=0x55b388200f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388200f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 -- 172.21.15.146:0/3122984804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3880ec820 con 0x55b3881dc230 2024-08-17T02:26:18.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40d1a00640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b3881d5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:18.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40cbe00640 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40b80099a0 tx=0x7f40b8006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ed284228292942 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40bcc00640 1 -- 172.21.15.146:0/3122984804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800e9c0 con 0x55b3881dc230 2024-08-17T02:26:18.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40bcc00640 1 -- 172.21.15.146:0/3122984804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800eb20 con 0x55b3881dc230 2024-08-17T02:26:18.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.517+0000 7f40bcc00640 1 -- 172.21.15.146:0/3122984804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800eee0 con 0x55b3881dc230 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 -- 172.21.15.146:0/3122984804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 msgr2=0x55b38821e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40b80099a0 tx=0x7f40b8006f50 comp rx=0 tx=0).stop 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 -- 172.21.15.146:0/3122984804 shutdown_connections 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b38821e760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b3881d5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/3122984804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388200f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 -- 172.21.15.146:0/3122984804 >> 172.21.15.146:0/3122984804 conn(0x55b388174030 msgr2=0x55b388222e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 -- 172.21.15.146:0/3122984804 shutdown_connections 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.518+0000 7f40d5fd6740 1 -- 172.21.15.146:0/3122984804 wait complete. 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.519+0000 7f40d5fd6740 1 -- start start 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.519+0000 7f40d5fd6740 1 Processor -- start 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b3882081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b388208710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b388138f60 con 0x55b3881dc230 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3880e1690 con 0x55b388200bc0 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3880e1330 con 0x55b38821eca0 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d5fd6740 10 client.0 _ll_register_callbacks cb 0x55b3880db2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41884/0 (socket says 172.21.15.146:41884) 2024-08-17T02:26:18.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 -- 172.21.15.146:0/1556827186 learned_addr learned my addr 172.21.15.146:0/1556827186 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40cbe00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b3882081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1a00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b388208710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 -- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 msgr2=0x55b388208710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b388208710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 -- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 msgr2=0x55b3882081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b3882081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1000640 1 -- 172.21.15.146:0/1556827186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b80095d0 con 0x55b3881dc230 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40d1a00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b388208710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.520+0000 7f40cbe00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b3882081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d1000640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40c0015be0 tx=0x7f40c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04a8c0a7b384a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0013d40 con 0x55b3881dc230 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40c001a040 con 0x55b3881dc230 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b38816cd20 con 0x55b3881dc230 2024-08-17T02:26:18.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40c0013ea0 con 0x55b3881dc230 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 10 client.4650 fetch_fsmap learned FSMap version 8 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b388102ab0 con 0x55b3881dc230 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b38816cd20 con 0x55b3881dc230 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40c0011040 con 0x55b3881dc230 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 10 client.4650 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 20 client.4650 populate_metadata read hostname 'smithi146' 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b388231e10 0x55b3881fc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 4 client.4650 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.521+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 --> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b387e403c0 con 0x55b388231e10 2024-08-17T02:26:18.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.522+0000 7f40cbe00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b388231e10 0x55b3881fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.522+0000 7f40cbe00640 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b388231e10 0x55b3881fc060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45664f36ea1d1709 server_cookie=a56ac4147335e24b in_seq=0 out_seq=0 2024-08-17T02:26:18.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.522+0000 7f40b1600640 10 client.4650 ms_handle_connect on v2:172.21.15.146:6835/3496457616 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40b1600640 1 -- 172.21.15.146:0/1556827186 <== mds.0 v2:172.21.15.146:6835/3496457616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55b387e403c0 con 0x55b388231e10 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40b1600640 10 client.4650 handle_command_reply: tid=0 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 client.4650 shutdown 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 msgr2=0x55b388205cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40c0015be0 tx=0x7f40c0017000 comp rx=0 tx=0).stop 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 shutdown_connections 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b388231e10 0x55b3881fc060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b38821eca0 0x55b388208710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b3882081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/1556827186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b3881dc230 0x55b388205cf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40b1600640 0 client.4650 ms_handle_reset on v2:172.21.15.146:6835/3496457616 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.523+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 >> 172.21.15.146:0/1556827186 conn(0x55b388174030 msgr2=0x55b388204330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.524+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 shutdown_connections 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.524+0000 7f40d5fd6740 1 -- 172.21.15.146:0/1556827186 wait complete. 2024-08-17T02:26:18.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.524+0000 7f40d5fd6740 20 client.4650 trim_cache size 0 max 16384 2024-08-17T02:26:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.539+0000 7f40d5fd6740 1 Processor -- start 2024-08-17T02:26:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.539+0000 7f40d5fd6740 1 -- start start 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388222e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38822f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b387eb3f20 con 0x55b38821eca0 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3881fffc0 con 0x55b388200bc0 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3881d6c50 con 0x55b3882049b0 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41894/0 (socket says 172.21.15.146:41894) 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40cbe00640 1 -- 172.21.15.146:0/609908266 learned_addr learned my addr 172.21.15.146:0/609908266 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.540+0000 7f40d1000640 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388222e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40d1a00640 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38822f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 -- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 msgr2=0x55b38822f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38822f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 -- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 msgr2=0x55b388222e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388222e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 -- 172.21.15.146:0/609908266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b388106490 con 0x55b38821eca0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40cbe00640 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40b8014000 tx=0x7f40b801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe919dba1a0942c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40bd600640 1 -- 172.21.15.146:0/609908266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b801f070 con 0x55b38821eca0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40bd600640 1 -- 172.21.15.146:0/609908266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8029110 con 0x55b38821eca0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.541+0000 7f40bd600640 1 -- 172.21.15.146:0/609908266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80292c0 con 0x55b38821eca0 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- 172.21.15.146:0/609908266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 msgr2=0x55b3881d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40b8014000 tx=0x7f40b801d040 comp rx=0 tx=0).stop 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- 172.21.15.146:0/609908266 shutdown_connections 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b3881d0750 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38822f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/609908266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388222e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- 172.21.15.146:0/609908266 >> 172.21.15.146:0/609908266 conn(0x55b388174030 msgr2=0x55b3881dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- 172.21.15.146:0/609908266 shutdown_connections 2024-08-17T02:26:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- 172.21.15.146:0/609908266 wait complete. 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.542+0000 7f40d5fd6740 1 -- start start 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 Processor -- start 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388280fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38821b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3881fea20 con 0x55b38821eca0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3881da2d0 con 0x55b388200bc0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.543+0000 7f40d5fd6740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b388287e40 con 0x55b3882049b0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d5fd6740 10 client.0 _ll_register_callbacks cb 0x7f40c0015730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41896/0 (socket says 172.21.15.146:41896) 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 -- 172.21.15.146:0/2690728523 learned_addr learned my addr 172.21.15.146:0/2690728523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40cbe00640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38821b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1000640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388280fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 -- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 msgr2=0x55b38821b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38821b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 -- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 msgr2=0x55b388280fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388280fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 -- 172.21.15.146:0/2690728523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3880ec820 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40d1a00640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40c4032fd0 tx=0x7f40c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a04e6b30779abad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40b1600640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.544+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4075770 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40c407c890 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40b800eb20 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40c40720b0 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 10 client.4656 fetch_fsmap learned FSMap version 8 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b3881061e0 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4095020 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f40c4074e90 con 0x55b38821eca0 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 10 client.4656 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:26:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 20 client.4656 populate_metadata read hostname 'smithi146' 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b38822e1a0 0x55b38822e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 4 client.4656 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 --> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b387e516c0 con 0x55b38822e1a0 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.545+0000 7f40d1000640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b38822e1a0 0x55b38822e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d1000640 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b38822e1a0 0x55b38822e570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ee3b0a3d13dc2c server_cookie=b536901ecd884d08 in_seq=0 out_seq=0 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40b1600640 10 client.4656 ms_handle_connect on v2:172.21.15.146:6835/3496457616 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40b1600640 1 -- 172.21.15.146:0/2690728523 <== mds.0 v2:172.21.15.146:6835/3496457616 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55b387e516c0 con 0x55b38822e1a0 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40b1600640 10 client.4656 handle_command_reply: tid=0 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 client.4656 shutdown 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 msgr2=0x55b38821ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f40c4032fd0 tx=0x7f40c4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 shutdown_connections 2024-08-17T02:26:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:6835/3496457616,v1:172.21.15.146:6837/3496457616] conn(0x55b38822e1a0 0x55b38822e570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b38821eca0 0x55b38821ba40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b3882049b0 0x55b38821b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 --2- 172.21.15.146:0/2690728523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b388200bc0 0x55b388280fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40b1600640 0 client.4656 ms_handle_reset on v2:172.21.15.146:6835/3496457616 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 >> 172.21.15.146:0/2690728523 conn(0x55b388174030 msgr2=0x55b388208070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.546+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 shutdown_connections 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d5fd6740 1 -- 172.21.15.146:0/2690728523 wait complete. 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d5fd6740 20 client.4656 trim_cache size 0 max 16384 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:26:18.552 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "955175c7-decf-4b1d-aa3f-b20724739e7d", 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4297, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 14.88010133, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 8, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 20, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 20, 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 22.090085240000001 2024-08-17T02:26:18.553 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:26:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 msgr2=0x7f40ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 0x7f40ac067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40c000acc0 tx=0x7f40c0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 msgr2=0x7f40cc0af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009f50 tx=0x7f40c4034000 comp rx=0 tx=0).stop 2024-08-17T02:26:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 shutdown_connections 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f40ac065150 0x7f40ac067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40cc156ea0 0x7f40cc0af190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40cc156ad0 0x7f40cc14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 --2- 172.21.15.146:0/2388051866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40cc06dc80 0x7f40cc0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 >> 172.21.15.146:0/2388051866 conn(0x7f40cc067750 msgr2=0x7f40cc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 shutdown_connections 2024-08-17T02:26:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:18.547+0000 7f40d2400640 1 -- 172.21.15.146:0/2388051866 wait complete. 2024-08-17T02:26:18.564 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:26:18.588 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:26:18.588 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:26:18.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.589 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:26:18.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-08-17T02:26:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:18.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:18.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.728 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:26:18.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-08-17T02:26:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:18.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:18.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.866 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:26:18.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:18.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-08-17T02:26:19.014 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:19.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:19.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:19.016 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:26:19.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:19.052 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-08-17T02:26:19.150 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-08-17T02:26:19.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:26:19.153 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:26:19.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.300+0000 7ff9dda00640 1 Processor -- start 2024-08-17T02:26:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.300+0000 7ff9dda00640 1 -- start start 2024-08-17T02:26:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9dda00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9dda00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9d80b1440 0x7ff9d80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9dda00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d80caa80 con 0x7ff9d8140580 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9dda00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80cb450 con 0x7ff9d80b1440 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9dda00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c9e70 con 0x7ff9d81401b0 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9ce000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff9d8140580 0x7ff9d80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53112/0 (socket says 172.21.15.146:53112) 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9ce000640 1 -- 172.21.15.146:0/3821770802 learned_addr learned my addr 172.21.15.146:0/3821770802 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/3821770802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d7400640 1 --2- 172.21.15.146:0/3821770802 >> v2:172.21.15.150:3300/0 conn(0x7ff9d80b1440 0x7ff9d80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6000640 1 -- 172.21.15.146:0/3821770802 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347543855 0 0) 0x7ff9d80caa80 con 0x7ff9d8140580 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6000640 1 -- 172.21.15.146:0/3821770802 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9bc0034e0 con 0x7ff9d8140580 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6a00640 1 -- 172.21.15.146:0/3821770802 >> v2:172.21.15.150:3300/0 conn(0x7ff9d80b1440 msgr2=0x7ff9d80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/3821770802 >> v2:172.21.15.150:3300/0 conn(0x7ff9d80b1440 0x7ff9d80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6a00640 1 -- 172.21.15.146:0/3821770802 >> v1:172.21.15.146:6789/0 conn(0x7ff9d8140580 legacy=0x7ff9d80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.302+0000 7ff9d6a00640 1 -- 172.21.15.146:0/3821770802 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80ca150 con 0x7ff9d81401b0 2024-08-17T02:26:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.303+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/3821770802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80caf10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009850 tx=0x7ff9c80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1269ac4ee5b89060 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9d6000640 1 -- 172.21.15.146:0/3821770802 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c802ad00 con 0x7ff9d81401b0 2024-08-17T02:26:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9d6000640 1 -- 172.21.15.146:0/3821770802 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c802ae60 con 0x7ff9d81401b0 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9d6000640 1 -- 172.21.15.146:0/3821770802 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8032670 con 0x7ff9d81401b0 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 -- 172.21.15.146:0/3821770802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 msgr2=0x7ff9d80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 --2- 172.21.15.146:0/3821770802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80caf10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009850 tx=0x7ff9c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 -- 172.21.15.146:0/3821770802 shutdown_connections 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 --2- 172.21.15.146:0/3821770802 >> v2:172.21.15.150:3300/0 conn(0x7ff9d80b1440 0x7ff9d80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 --2- 172.21.15.146:0/3821770802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80caf10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 -- 172.21.15.146:0/3821770802 >> 172.21.15.146:0/3821770802 conn(0x7ff9d80cb9b0 msgr2=0x7ff9d80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.304+0000 7ff9dda00640 1 -- 172.21.15.146:0/3821770802 shutdown_connections 2024-08-17T02:26:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.305+0000 7ff9dda00640 1 -- 172.21.15.146:0/3821770802 wait complete. 2024-08-17T02:26:19.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.306+0000 7ff9dda00640 1 Processor -- start 2024-08-17T02:26:19.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.306+0000 7ff9dda00640 1 -- start start 2024-08-17T02:26:19.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80b1440 0x7ff9d80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d813f5e0 con 0x7ff9d8140580 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80ab460 con 0x7ff9d80b1440 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9dda00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80aa850 con 0x7ff9d81401b0 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41910/0 (socket says 172.21.15.146:41910) 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 -- 172.21.15.146:0/2386059178 learned_addr learned my addr 172.21.15.146:0/2386059178 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9ce000640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80b1440 0x7ff9d80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 -- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 msgr2=0x7ff9d80c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 -- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80b1440 msgr2=0x7ff9d80ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80b1440 0x7ff9d80ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9d7400640 1 -- 172.21.15.146:0/2386059178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009390 con 0x7ff9d8140580 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.307+0000 7ff9ce000640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9d7400640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009d40 tx=0x7ff9d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0009ea0 con 0x7ff9d8140580 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000f040 con 0x7ff9d8140580 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d80aab30 con 0x7ff9d8140580 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0014480 con 0x7ff9d8140580 2024-08-17T02:26:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.308+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80ab0f0 con 0x7ff9d8140580 2024-08-17T02:26:19.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.309+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d80ab5f0 con 0x7ff9d8140580 2024-08-17T02:26:19.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.310+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9d0014830 con 0x7ff9d8140580 2024-08-17T02:26:19.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.311+0000 7ff9cea00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 0x7ff9b4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:19.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.311+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9d0083090 con 0x7ff9d8140580 2024-08-17T02:26:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.311+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 0x7ff9b4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.311+0000 7ff9d6a00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 0x7ff9b4067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8034000 tx=0x7ff9c8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.315+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9d00510b0 con 0x7ff9d8140580 2024-08-17T02:26:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.524+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9d8064db0 con 0x7ff9d8140580 2024-08-17T02:26:19.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.525+0000 7ff9cea00640 1 -- 172.21.15.146:0/2386059178 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff9d00546d0 con 0x7ff9d8140580 2024-08-17T02:26:19.526 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 msgr2=0x7ff9b4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 0x7ff9b4067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8034000 tx=0x7ff9c8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 msgr2=0x7ff9d80c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009d40 tx=0x7ff9d000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 shutdown_connections 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff9b4065180 0x7ff9b4067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9d8140580 0x7ff9d80c52f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9d81401b0 0x7ff9d80c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 --2- 172.21.15.146:0/2386059178 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9d80b1440 0x7ff9d80ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 >> 172.21.15.146:0/2386059178 conn(0x7ff9d80cb9b0 msgr2=0x7ff9d8159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 shutdown_connections 2024-08-17T02:26:19.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:19.527+0000 7ff9dda00640 1 -- 172.21.15.146:0/2386059178 wait complete. 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:19.543 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:19.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:19.543 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-08-17T02:26:19.579 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:19.579 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:19.579 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:19.579 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:19.580 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42674sec preferred_lft 42674sec 2024-08-17T02:26:19.581 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-08-17T02:26:19.581 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:19.581 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:19.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:19.581 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:19.581 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:19.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:19.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:19.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2024-08-17T02:26:19.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:19.582 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:19.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:19.981 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:20.038 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-08-17T02:26:20.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.040 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:20.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:20.115 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:20.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.684 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:26:20.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.720 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-08-17T02:26:20.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.797 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:20.797 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:20.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:20.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:26:20.797 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:20.927 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:26:20.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:20.927 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:20.927 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:20.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:26:20.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:20.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:26:20.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:26:20.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:26:20.928 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:21.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:21.123 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:21.123 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:21.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-08-17T02:26:21.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:21.123 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:21.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:21.240 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:21.276 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:21.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:21.277 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:21.352 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:26:21.352 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:21.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:21.496 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:22.094 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:22.095 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:22.096 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:22.096 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:22.099 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:22.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:22.158 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:26:22.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:22.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.307+0000 7f677f200640 1 Processor -- start 2024-08-17T02:26:22.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.307+0000 7f677f200640 1 -- start start 2024-08-17T02:26:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677f200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6780158800 0x7f6780156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677f200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800cc300 con 0x7f6780156ad0 2024-08-17T02:26:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677f200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800caaf0 con 0x7f67800cbea0 2024-08-17T02:26:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677f200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800ca900 con 0x7f6780158800 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6780156ad0 0x7f678006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53118/0 (socket says 172.21.15.146:53118) 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.308+0000 7f677de00640 1 -- 172.21.15.146:0/1958092134 learned_addr learned my addr 172.21.15.146:0/1958092134 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677e800640 1 --2- 172.21.15.146:0/1958092134 >> v2:172.21.15.150:3300/0 conn(0x7f6780158800 0x7f6780156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176599092 0 0) 0x7f67800cc300 con 0x7f6780156ad0 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67640034e0 con 0x7f6780156ad0 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159276086 0 0) 0x7f67640034e0 con 0x7f6780156ad0 2024-08-17T02:26:22.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 >> v2:172.21.15.150:3300/0 conn(0x7f6780158800 msgr2=0x7f6780156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 --2- 172.21.15.146:0/1958092134 >> v2:172.21.15.150:3300/0 conn(0x7f6780158800 0x7f6780156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 >> v1:172.21.15.150:6789/0 conn(0x7f67800cbea0 legacy=0x7f678006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678006e390 con 0x7f6780156ad0 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f6770001470 con 0x7f6780156ad0 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 >> v1:172.21.15.146:6789/0 conn(0x7f6780156ad0 legacy=0x7f678006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67640039d0 0x7f6764003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6764004780 0x7f6764004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f676400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676400c010 con 0x7f6764005130 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676400c180 con 0x7f6764004780 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676400c340 con 0x7f67640039d0 2024-08-17T02:26:22.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f677e800640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f676400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.309+0000 7f6775400640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6764004780 0x7f6764004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677de00640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67640039d0 0x7f6764003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677e800640 1 -- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67640039d0 msgr2=0x7f6764003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677e800640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67640039d0 0x7f6764003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677e800640 1 -- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6764004780 msgr2=0x7f6764004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677e800640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6764004780 0x7f6764004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.310+0000 7f677e800640 1 -- 172.21.15.146:0/1958092134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640034e0 con 0x7f6764005130 2024-08-17T02:26:22.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677e800640 1 -- 172.21.15.146:0/1958092134 reap_dead start 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677e800640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f676400b9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f677800e210 tx=0x7f677800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ade6c48f5b5fb7f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677802c040 con 0x7f6764005130 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677800f040 con 0x7f6764005130 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677d400640 1 -- 172.21.15.146:0/1958092134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778030650 con 0x7f6764005130 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.311+0000 7f677f200640 1 -- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 msgr2=0x7f676400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f676400b9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f677800e210 tx=0x7f677800b040 comp rx=0 tx=0).stop 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 -- 172.21.15.146:0/1958092134 shutdown_connections 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 --2- 172.21.15.146:0/1958092134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f676400b9d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 -- 172.21.15.146:0/1958092134 >> 172.21.15.146:0/1958092134 conn(0x7f6780067750 msgr2=0x7f67800cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 -- 172.21.15.146:0/1958092134 shutdown_connections 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.312+0000 7f677f200640 1 -- 172.21.15.146:0/1958092134 wait complete. 2024-08-17T02:26:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.313+0000 7f677f200640 1 Processor -- start 2024-08-17T02:26:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.313+0000 7f677f200640 1 -- start start 2024-08-17T02:26:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67800c5660 0x7f67800acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67800c3d00 0x7f67800693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c51d0 con 0x7f6764005130 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800ad220 con 0x7f67800c3d00 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677f200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800c45c0 con 0x7f67800c5660 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41928/0 (socket says 172.21.15.146:41928) 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677de00640 1 -- 172.21.15.146:0/215410661 learned_addr learned my addr 172.21.15.146:0/215410661 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f6775400640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67800c5660 0x7f67800acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.314+0000 7f677e800640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67800c3d00 0x7f67800693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 -- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67800c5660 msgr2=0x7f67800acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67800c5660 0x7f67800acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 -- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67800c3d00 msgr2=0x7f67800693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67800c3d00 0x7f67800693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 -- 172.21.15.146:0/215410661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800c48a0 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677de00640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6770004b00 tx=0x7f678006e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000f960 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677000fac0 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67800c4b80 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000fe60 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.315+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800c5ad0 con 0x7f6764005130 2024-08-17T02:26:22.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.316+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67800c7d00 con 0x7f6764005130 2024-08-17T02:26:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.317+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6770013600 con 0x7f6764005130 2024-08-17T02:26:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.318+0000 7f6776000640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 0x7f675c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.318+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6770082530 con 0x7f6764005130 2024-08-17T02:26:22.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.318+0000 7f6775400640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 0x7f675c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:22.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.319+0000 7f6775400640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 0x7f675c067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6780148170 tx=0x7f6768007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:22.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.322+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6770050550 con 0x7f6764005130 2024-08-17T02:26:22.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.530+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6780071050 con 0x7f6764005130 2024-08-17T02:26:22.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.531+0000 7f6776000640 1 -- 172.21.15.146:0/215410661 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6770053b70 con 0x7f6764005130 2024-08-17T02:26:22.532 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 msgr2=0x7f675c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 0x7f675c067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6780148170 tx=0x7f6768007ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 msgr2=0x7f67800c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6770004b00 tx=0x7f678006e520 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 shutdown_connections 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f675c065180 0x7f675c067630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67800c3d00 0x7f67800693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f67800c5660 0x7f67800acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 --2- 172.21.15.146:0/215410661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6764005130 0x7f67800c6530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 >> 172.21.15.146:0/215410661 conn(0x7f6780067750 msgr2=0x7f678006d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 shutdown_connections 2024-08-17T02:26:22.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:22.533+0000 7f677f200640 1 -- 172.21.15.146:0/215410661 wait complete. 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:22.549 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:22.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.550 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-08-17T02:26:22.584 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:22.585 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ce:cd:af:7e:d9:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:22.586 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1c02:d4ff:fe24:9cf/64 scope link 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ce:cd:af:7e:d9:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::cccd:afff:fe7e:d9b3/64 scope link tentative 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:22.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.588 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:22.682 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-08-17T02:26:22.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.686 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-08-17T02:26:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-08-17T02:26:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:22.722 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:22.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.723 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:22.723 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:22.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:22.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:22.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:22.724 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:22.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.872 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:26:22.908 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:22.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.909 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-08-17T02:26:22.984 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:26:22.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:22.985 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:22.986 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:22.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:22.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:26:22.986 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:23.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:23.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:23.166 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 86:a9:1f:b3:49:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::84a9:1fff:feb3:4941/64 scope link 2024-08-17T02:26:23.167 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:23.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.225 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 86:a9:1f:b3:49:41 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::84a9:1fff:feb3:4941/64 scope link 2024-08-17T02:26:23.226 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:23.228 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:26:23.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:23.228 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:23.228 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:26:23.229 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:23.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:23.395 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:23.395 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:23.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2024-08-17T02:26:23.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:23.395 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:26:23.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:23.511 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:23.547 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:26:23.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:23.547 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:23.622 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:26:23.622 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:23.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:23.744 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:23.744 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:23.771 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:23.771 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:23.771 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:26:23.771 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 2@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:26:23.771 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:26:23.773 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:26:23.773 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:23.773 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:23.773 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:23.773 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:23.776 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:23.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:23.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:26:23.832 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:26:23.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.980+0000 7f2799a00640 1 Processor -- start 2024-08-17T02:26:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.980+0000 7f2799a00640 1 -- start start 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2799a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 0x7f27940ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2799a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27940a98e0 0x7f27940afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2799a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27940ab950 con 0x7f27940b03d0 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2799a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27940abc30 con 0x7f27940a98e0 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2799a00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27940abf10 con 0x7f27940cc010 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27940a98e0 0x7f27940afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27940a98e0 0x7f27940afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41942/0 (socket says 172.21.15.146:41942) 2024-08-17T02:26:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 -- 172.21.15.146:0/577218141 learned_addr learned my addr 172.21.15.146:0/577218141 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:23.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 -- 172.21.15.146:0/577218141 >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 msgr2=0x7f27940ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2793e00640 1 --2- 172.21.15.146:0/577218141 >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 0x7f27940ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 --2- 172.21.15.146:0/577218141 >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 0x7f27940ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 -- 172.21.15.146:0/577218141 >> v1:172.21.15.150:6789/0 conn(0x7f27940b03d0 legacy=0x7f279415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f278b400640 1 -- 172.21.15.146:0/577218141 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27940af970 con 0x7f27940a98e0 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.982+0000 7f2793e00640 1 --2- 172.21.15.146:0/577218141 >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 0x7f27940ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.983+0000 7f278b400640 1 --2- 172.21.15.146:0/577218141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f27940afe90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2794064c30 tx=0x7f277c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892bb8e386423482 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2793400640 1 -- 172.21.15.146:0/577218141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c02ad50 con 0x7f27940a98e0 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2793400640 1 -- 172.21.15.146:0/577218141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c032440 con 0x7f27940a98e0 2024-08-17T02:26:23.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2793400640 1 -- 172.21.15.146:0/577218141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c032820 con 0x7f27940a98e0 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 -- 172.21.15.146:0/577218141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 msgr2=0x7f27940afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 --2- 172.21.15.146:0/577218141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f27940afe90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2794064c30 tx=0x7f277c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 -- 172.21.15.146:0/577218141 shutdown_connections 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 --2- 172.21.15.146:0/577218141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f27940afe90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 --2- 172.21.15.146:0/577218141 >> v2:172.21.15.150:3300/0 conn(0x7f27940cc010 0x7f27940ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 -- 172.21.15.146:0/577218141 >> 172.21.15.146:0/577218141 conn(0x7f2794067de0 msgr2=0x7f27940681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 -- 172.21.15.146:0/577218141 shutdown_connections 2024-08-17T02:26:23.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.984+0000 7f2799a00640 1 -- 172.21.15.146:0/577218141 wait complete. 2024-08-17T02:26:23.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.986+0000 7f2799a00640 1 Processor -- start 2024-08-17T02:26:23.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.986+0000 7f2799a00640 1 -- start start 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27940b03d0 0x7f27940c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 0x7f27940c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279416a490 con 0x7f27940a98e0 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2794169100 con 0x7f27940b03d0 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279416a0b0 con 0x7f27940cc010 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41952/0 (socket says 172.21.15.146:41952) 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 -- 172.21.15.146:0/1945655943 learned_addr learned my addr 172.21.15.146:0/1945655943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f278b400640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27940b03d0 0x7f27940c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799000640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 0x7f27940c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 -- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 msgr2=0x7f27940c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 0x7f27940c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 -- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27940b03d0 msgr2=0x7f27940c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27940b03d0 0x7f27940c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2793e00640 1 -- 172.21.15.146:0/1945655943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c009450 con 0x7f27940a98e0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.987+0000 7f2799000640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 0x7f27940c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f2793e00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f278400c880 tx=0x7f2784008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400ce10 con 0x7f27940a98e0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784007830 con 0x7f27940a98e0 2024-08-17T02:26:23.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784007c10 con 0x7f27940a98e0 2024-08-17T02:26:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279416a6e0 con 0x7f27940a98e0 2024-08-17T02:26:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.988+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279416aca0 con 0x7f27940a98e0 2024-08-17T02:26:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.989+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2794071050 con 0x7f27940a98e0 2024-08-17T02:26:23.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.990+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2784011600 con 0x7f27940a98e0 2024-08-17T02:26:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.991+0000 7f278be00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 0x7f2770067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.991+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2784082710 con 0x7f27940a98e0 2024-08-17T02:26:23.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.991+0000 7f278b400640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 0x7f2770067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:23.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.992+0000 7f278b400640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 0x7f2770067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:23.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:23.996+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2784050880 con 0x7f27940a98e0 2024-08-17T02:26:24.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.204+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27940aa890 con 0x7f27940a98e0 2024-08-17T02:26:24.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.204+0000 7f278be00640 1 -- 172.21.15.146:0/1945655943 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2784053ea0 con 0x7f27940a98e0 2024-08-17T02:26:24.206 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 msgr2=0x7f2770067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 0x7f2770067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 msgr2=0x7f2794168bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f278400c880 tx=0x7f2784008040 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 shutdown_connections 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2770065150 0x7f2770067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27940cc010 0x7f27940c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27940b03d0 0x7f27940c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 --2- 172.21.15.146:0/1945655943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27940a98e0 0x7f2794168bc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:24.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 >> 172.21.15.146:0/1945655943 conn(0x7f2794067de0 msgr2=0x7f2794066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.206+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 shutdown_connections 2024-08-17T02:26:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:24.207+0000 7f2799a00640 1 -- 172.21.15.146:0/1945655943 wait complete. 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:24.223 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:24.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.224 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:24.266 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:24.267 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42603sec preferred_lft 42603sec 2024-08-17T02:26:24.268 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-08-17T02:26:24.268 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:24.269 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:26:24.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:26:24.269 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:24.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.633 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:24.689 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-08-17T02:26:24.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.692 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:24.754 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:24.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:24.755 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:25.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.290 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:26:25.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.326 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-08-17T02:26:25.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.401 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:25.402 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:25.402 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:25.402 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:26:25.402 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:25.527 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:26:25.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:26:25.528 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:25.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:25.711 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:25.711 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:25.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-08-17T02:26:25.711 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:26:25.711 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:25.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:25.827 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:25.863 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:25.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:25.863 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:25.938 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:26:25.938 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:25.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:26.070 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:26.070 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:26:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with new device syntax: 1@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:26:26.674 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:26:26.675 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:26:26.675 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:26.676 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:26.676 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:26.676 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:26.679 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:26.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:26.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:26.736 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:26:26.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.898+0000 7f64f0800640 1 Processor -- start 2024-08-17T02:26:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.898+0000 7f64f0800640 1 -- start start 2024-08-17T02:26:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f64e806da20 0x7f64e806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e8158dd0 0x7f64e80ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80ac400 con 0x7f64e8158dd0 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80a9a10 con 0x7f64e806da20 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.899+0000 7f64f0800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80a9cf0 con 0x7f64e80aa7d0 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e8158dd0 0x7f64e80ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64e8158dd0 0x7f64e80ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48296/0 (socket says 172.21.15.146:48296) 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 -- 172.21.15.146:0/2414235984 learned_addr learned my addr 172.21.15.146:0/2414235984 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ede00640 1 --2- 172.21.15.146:0/2414235984 >> v2:172.21.15.150:3300/0 conn(0x7f64e806da20 0x7f64e806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ed400640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 -- 172.21.15.146:0/2414235984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 msgr2=0x7f64e8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 -- 172.21.15.146:0/2414235984 >> v2:172.21.15.150:3300/0 conn(0x7f64e806da20 msgr2=0x7f64e806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:26.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 --2- 172.21.15.146:0/2414235984 >> v2:172.21.15.150:3300/0 conn(0x7f64e806da20 0x7f64e806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.900+0000 7f64ee800640 1 -- 172.21.15.146:0/2414235984 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80a9fd0 con 0x7f64e8158dd0 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.901+0000 7f64ee800640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e80ab6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64e8068280 tx=0x7f64e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b25b968a6c8b0da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.901+0000 7f64eca00640 1 -- 172.21.15.146:0/2414235984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4031400 con 0x7f64e8158dd0 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.901+0000 7f64eca00640 1 -- 172.21.15.146:0/2414235984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e402d050 con 0x7f64e8158dd0 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.901+0000 7f64eca00640 1 -- 172.21.15.146:0/2414235984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40317d0 con 0x7f64e8158dd0 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 -- 172.21.15.146:0/2414235984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 msgr2=0x7f64e80ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e80ab6d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64e8068280 tx=0x7f64e4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 -- 172.21.15.146:0/2414235984 shutdown_connections 2024-08-17T02:26:26.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e80ab6d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 --2- 172.21.15.146:0/2414235984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 --2- 172.21.15.146:0/2414235984 >> v2:172.21.15.150:3300/0 conn(0x7f64e806da20 0x7f64e806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 -- 172.21.15.146:0/2414235984 >> 172.21.15.146:0/2414235984 conn(0x7f64e80cb9b0 msgr2=0x7f64e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 -- 172.21.15.146:0/2414235984 shutdown_connections 2024-08-17T02:26:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.902+0000 7f64f0800640 1 -- 172.21.15.146:0/2414235984 wait complete. 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.903+0000 7f64f0800640 1 Processor -- start 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 -- start start 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e806da20 0x7f64e815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e815a190 con 0x7f64e8158dd0 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e815a470 con 0x7f64e806da20 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.904+0000 7f64f0800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e815a750 con 0x7f64e80aa7d0 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48306/0 (socket says 172.21.15.146:48306) 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 -- 172.21.15.146:0/2124097254 learned_addr learned my addr 172.21.15.146:0/2124097254 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ede00640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e806da20 0x7f64e815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ed400640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 -- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 msgr2=0x7f64e8153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 -- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e806da20 msgr2=0x7f64e815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e806da20 0x7f64e815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 -- 172.21.15.146:0/2124097254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4009ae0 con 0x7f64e8158dd0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.905+0000 7f64ee800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f64e402ac20 tx=0x7f64e4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.906+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e4031880 con 0x7f64e8158dd0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.906+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4008e50 con 0x7f64e8158dd0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.906+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e403b640 con 0x7f64e8158dd0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.906+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80aebc0 con 0x7f64e8158dd0 2024-08-17T02:26:26.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.906+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e815b610 con 0x7f64e8158dd0 2024-08-17T02:26:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.907+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e80aea20 con 0x7f64e8158dd0 2024-08-17T02:26:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.907+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f64e4038050 con 0x7f64e8158dd0 2024-08-17T02:26:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.909+0000 7f64e1600640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.909+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64e40a2a80 con 0x7f64e8158dd0 2024-08-17T02:26:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.909+0000 7f64ede00640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:26.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.909+0000 7f64ede00640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 0x7f64cc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009cb0 tx=0x7f64dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:26.912+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f64e80aea20 con 0x7f64e8158dd0 2024-08-17T02:26:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.122+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64e80aea20 con 0x7f64e8158dd0 2024-08-17T02:26:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.122+0000 7f64e1600640 1 -- 172.21.15.146:0/2124097254 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64e4048060 con 0x7f64e8158dd0 2024-08-17T02:26:27.124 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 msgr2=0x7f64cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 0x7f64cc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009cb0 tx=0x7f64dc008040 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 msgr2=0x7f64e8153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f64e402ac20 tx=0x7f64e4036000 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 shutdown_connections 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f64cc065150 0x7f64cc067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e8158dd0 0x7f64e8153790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f64e80aa7d0 0x7f64e8153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 --2- 172.21.15.146:0/2124097254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e806da20 0x7f64e815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:27.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.124+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 >> 172.21.15.146:0/2124097254 conn(0x7f64e80cb9b0 msgr2=0x7f64e806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:27.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.125+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 shutdown_connections 2024-08-17T02:26:27.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:27.125+0000 7f64f0800640 1 -- 172.21.15.146:0/2124097254 wait complete. 2024-08-17T02:26:27.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:27.141 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:27.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.141 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:27.178 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42600sec preferred_lft 42600sec 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether ae:f6:66:21:1d:b5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:27.179 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::fc85:d5ff:fe83:c4c0/64 scope link 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether ae:f6:66:21:1d:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::acf6:66ff:fe21:1db5/64 scope link 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.180 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:27.271 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-08-17T02:26:27.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.275 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-08-17T02:26:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:27.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:27.311 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:27.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.457 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:26:27.492 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:27.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.493 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-08-17T02:26:27.566 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:26:27.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.568 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:27.568 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:27.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:27.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:26:27.568 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:27.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.694 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:27.751 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.751 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether da:1b:2e:51:29:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::d81b:2eff:fe51:2986/64 scope link 2024-08-17T02:26:27.752 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.754 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:26:27.811 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:27.811 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether da:1b:2e:51:29:86 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::d81b:2eff:fe51:2986/64 scope link 2024-08-17T02:26:27.812 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:27.814 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:26:27.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.814 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:27.814 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:27.814 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:26:27.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:26:27.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:26:27.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:26:27.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:26:27.815 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:27.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:27.982 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:26:27.983 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:26:27.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2024-08-17T02:26:27.983 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:26:27.983 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:26:28.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:28.099 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:28.133 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:26:28.134 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:28.134 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:28.208 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:26:28.209 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:28.209 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:28.331 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:28.331 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:28.357 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:28.357 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:28.358 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:26:28.358 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with new device syntax: 3@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:26:28.358 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:26:28.359 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:26:28.359 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:28.359 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:28.359 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:28.359 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:28.362 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:28.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:28.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:26:28.417 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:26:28.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:28.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.593+0000 7fb3e0c00640 1 Processor -- start 2024-08-17T02:26:28.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.593+0000 7fb3e0c00640 1 -- start start 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.594+0000 7fb3e0c00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3dc1401b0 0x7fb3dc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3e0c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3dc0b1440 0x7fb3dc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3e0c00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0caa80 con 0x7fb3dc140580 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3e0c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0cb450 con 0x7fb3dc0b1440 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3e0c00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c9e70 con 0x7fb3dc1401b0 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3dc0b1440 0x7fb3dc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3dc0b1440 0x7fb3dc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48308/0 (socket says 172.21.15.146:48308) 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 -- 172.21.15.146:0/1992774245 learned_addr learned my addr 172.21.15.146:0/1992774245 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:28.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3d9e00640 1 --2- 172.21.15.146:0/1992774245 >> v2:172.21.15.150:3300/0 conn(0x7fb3dc1401b0 0x7fb3dc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 -- 172.21.15.146:0/1992774245 >> v2:172.21.15.150:3300/0 conn(0x7fb3dc1401b0 msgr2=0x7fb3dc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 --2- 172.21.15.146:0/1992774245 >> v2:172.21.15.150:3300/0 conn(0x7fb3dc1401b0 0x7fb3dc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 -- 172.21.15.146:0/1992774245 >> v1:172.21.15.150:6789/0 conn(0x7fb3dc140580 legacy=0x7fb3dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.595+0000 7fb3da800640 1 -- 172.21.15.146:0/1992774245 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0ca150 con 0x7fb3dc0b1440 2024-08-17T02:26:28.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.596+0000 7fb3da800640 1 --2- 172.21.15.146:0/1992774245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc0c9040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc068650 tx=0x7fb3d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aac5499c5363a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3d9400640 1 -- 172.21.15.146:0/1992774245 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4031400 con 0x7fb3dc0b1440 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3d9400640 1 -- 172.21.15.146:0/1992774245 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d402d050 con 0x7fb3dc0b1440 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3d9400640 1 -- 172.21.15.146:0/1992774245 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40317d0 con 0x7fb3dc0b1440 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 -- 172.21.15.146:0/1992774245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc0b1440 msgr2=0x7fb3dc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/1992774245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc0c9040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc068650 tx=0x7fb3d4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 -- 172.21.15.146:0/1992774245 shutdown_connections 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/1992774245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc0c9040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/1992774245 >> v2:172.21.15.150:3300/0 conn(0x7fb3dc1401b0 0x7fb3dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 -- 172.21.15.146:0/1992774245 >> 172.21.15.146:0/1992774245 conn(0x7fb3dc0cb9b0 msgr2=0x7fb3dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 -- 172.21.15.146:0/1992774245 shutdown_connections 2024-08-17T02:26:28.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.597+0000 7fb3e0c00640 1 -- 172.21.15.146:0/1992774245 wait complete. 2024-08-17T02:26:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.599+0000 7fb3e0c00640 1 Processor -- start 2024-08-17T02:26:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.599+0000 7fb3e0c00640 1 -- start start 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3dc1401b0 0x7fb3dc138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc140580 0x7fb3dc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1391e0 con 0x7fb3dc140580 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1394c0 con 0x7fb3dc0b1440 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3e0c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1397a0 con 0x7fb3dc1401b0 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3d9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3d9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:35294/0 (socket says 172.21.15.146:35294) 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3da800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc140580 0x7fb3dc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3d9e00640 1 -- 172.21.15.146:0/2027178265 learned_addr learned my addr 172.21.15.146:0/2027178265 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.600+0000 7fb3d3e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3dc1401b0 0x7fb3dc138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 -- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3dc1401b0 msgr2=0x7fb3dc138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3dc1401b0 0x7fb3dc138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 -- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc140580 msgr2=0x7fb3dc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc140580 0x7fb3dc1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 -- 172.21.15.146:0/2027178265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009ae0 con 0x7fb3dc0b1440 2024-08-17T02:26:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d9e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00ea20 tx=0x7fb3cc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00ca10 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00cb70 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc013470 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc139a80 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.601+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc138d80 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.602+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc064db0 con 0x7fb3dc0b1440 2024-08-17T02:26:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.603+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3cc013860 con 0x7fb3dc0b1440 2024-08-17T02:26:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.604+0000 7fb3d1600640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 0x7fb3b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.604+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3cc082730 con 0x7fb3dc0b1440 2024-08-17T02:26:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.604+0000 7fb3d3e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 0x7fb3b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.605+0000 7fb3d3e00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 0x7fb3b8067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4007fd0 tx=0x7fb3c4007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.608+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3cc050800 con 0x7fb3dc0b1440 2024-08-17T02:26:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.787+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3dc06a490 con 0x7fb3dc0b1440 2024-08-17T02:26:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.790+0000 7fb3d1600640 1 -- 172.21.15.146:0/2027178265 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb3cc053e20 con 0x7fb3dc0b1440 2024-08-17T02:26:28.791 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:28.791 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 msgr2=0x7fb3b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 0x7fb3b8067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4007fd0 tx=0x7fb3c4007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 msgr2=0x7fb3dc13a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00ea20 tx=0x7fb3cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 shutdown_connections 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb3b8065150 0x7fb3b8067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3dc140580 0x7fb3dc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3dc1401b0 0x7fb3dc138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 --2- 172.21.15.146:0/2027178265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3dc0b1440 0x7fb3dc13a280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 >> 172.21.15.146:0/2027178265 conn(0x7fb3dc0cb9b0 msgr2=0x7fb3dc156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 shutdown_connections 2024-08-17T02:26:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.792+0000 7fb3e0c00640 1 -- 172.21.15.146:0/2027178265 wait complete. 2024-08-17T02:26:28.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:28.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.961+0000 7f2911200640 1 Processor -- start 2024-08-17T02:26:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.961+0000 7f2911200640 1 -- start start 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.962+0000 7f2911200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f290c157e10 0x7f290c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.962+0000 7f2911200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.962+0000 7f2911200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c157070 con 0x7f290c0b0a80 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.962+0000 7f2911200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c0b1390 con 0x7f290c157e10 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.962+0000 7f2911200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c15b410 con 0x7f290c0adec0 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f290c157e10 0x7f290c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f290c157e10 0x7f290c0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:35310/0 (socket says 172.21.15.146:35310) 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 -- 172.21.15.146:0/4122117023 learned_addr learned my addr 172.21.15.146:0/4122117023 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f290a800640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909e00640 1 --1- 172.21.15.146:0/4122117023 >> v1:172.21.15.150:6789/0 conn(0x7f290c0b0a80 0x7f290c0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:57064/0 (socket says 172.21.15.146:57064) 2024-08-17T02:26:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 -- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 msgr2=0x7f290c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 -- 172.21.15.146:0/4122117023 >> v1:172.21.15.150:6789/0 conn(0x7f290c0b0a80 legacy=0x7f290c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.963+0000 7f2909400640 1 -- 172.21.15.146:0/4122117023 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c157330 con 0x7f290c157e10 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.964+0000 7f2909400640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c0b0e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009910 tx=0x7f28f80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0fb85613dfa73e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.964+0000 7f2908a00640 1 -- 172.21.15.146:0/4122117023 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f802add0 con 0x7f290c157e10 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.964+0000 7f2908a00640 1 -- 172.21.15.146:0/4122117023 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8032440 con 0x7f290c157e10 2024-08-17T02:26:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.964+0000 7f2908a00640 1 -- 172.21.15.146:0/4122117023 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8032820 con 0x7f290c157e10 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 -- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 msgr2=0x7f290c0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c0b0e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009910 tx=0x7f28f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 -- 172.21.15.146:0/4122117023 shutdown_connections 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 --2- 172.21.15.146:0/4122117023 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c0b0e50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 -- 172.21.15.146:0/4122117023 >> 172.21.15.146:0/4122117023 conn(0x7f290c067750 msgr2=0x7f290c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 -- 172.21.15.146:0/4122117023 shutdown_connections 2024-08-17T02:26:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.965+0000 7f2911200640 1 -- 172.21.15.146:0/4122117023 wait complete. 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.966+0000 7f2911200640 1 Processor -- start 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.967+0000 7f2911200640 1 -- start start 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.967+0000 7f2911200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c069920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2911200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2911200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2911200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c14f970 con 0x7f290c0b0a80 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2911200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c15f090 con 0x7f290c157e10 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2911200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c15f370 con 0x7f290c0adec0 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c069920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48332/0 (socket says 172.21.15.146:48332) 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 -- 172.21.15.146:0/573646367 learned_addr learned my addr 172.21.15.146:0/573646367 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f290a800640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 -- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 msgr2=0x7f290c069920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c069920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 -- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 msgr2=0x7f290c14e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c14e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909400640 1 -- 172.21.15.146:0/573646367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009450 con 0x7f290c0b0a80 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.968+0000 7f2909e00640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c069920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2909400640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009210 tx=0x7f28f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8031de0 con 0x7f290c0b0a80 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8000c40 con 0x7f290c0b0a80 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f803d670 con 0x7f290c0b0a80 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c15f650 con 0x7f290c0b0a80 2024-08-17T02:26:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.969+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c069e60 con 0x7f290c0b0a80 2024-08-17T02:26:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.970+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c14fb20 con 0x7f290c0b0a80 2024-08-17T02:26:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.971+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28f8039040 con 0x7f290c0b0a80 2024-08-17T02:26:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.972+0000 7f2901600640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 0x7f28ec067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.972+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28f80a2260 con 0x7f290c0b0a80 2024-08-17T02:26:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.972+0000 7f2909e00640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 0x7f28ec067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.973+0000 7f2909e00640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 0x7f28ec067630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0047a0 tx=0x7f28fc007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:28.976+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f290c14fb20 con 0x7f290c0b0a80 2024-08-17T02:26:29.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:29.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.149+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f290c14fb20 con 0x7f290c0b0a80 2024-08-17T02:26:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.150+0000 7f2901600640 1 -- 172.21.15.146:0/573646367 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28f8037020 con 0x7f290c0b0a80 2024-08-17T02:26:29.151 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 msgr2=0x7f28ec067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 0x7f28ec067630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0047a0 tx=0x7f28fc007e20 comp rx=0 tx=0).stop 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 msgr2=0x7f290c15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009210 tx=0x7f28f8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 shutdown_connections 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f28ec065180 0x7f28ec067630 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f290c0b0a80 0x7f290c15e690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f290c157e10 0x7f290c14e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 --2- 172.21.15.146:0/573646367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f290c0adec0 0x7f290c069920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.152+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 >> 172.21.15.146:0/573646367 conn(0x7f290c067750 msgr2=0x7f290c0686b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.153+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 shutdown_connections 2024-08-17T02:26:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.153+0000 7f2911200640 1 -- 172.21.15.146:0/573646367 wait complete. 2024-08-17T02:26:29.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.360+0000 7fc784e00640 1 Processor -- start 2024-08-17T02:26:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.360+0000 7fc784e00640 1 -- start start 2024-08-17T02:26:29.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc784e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7800c8bd0 0x7fc7800c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc784e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800ab130 con 0x7fc780156c50 2024-08-17T02:26:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc784e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800c9530 con 0x7fc7800adcf0 2024-08-17T02:26:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc784e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800ae5a0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc77de00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc780156c50 0x7fc7800c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39204/0 (socket says 172.21.15.146:39204) 2024-08-17T02:26:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc77de00640 1 -- 172.21.15.146:0/1860909627 learned_addr learned my addr 172.21.15.146:0/1860909627 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.361+0000 7fc77e800640 1 --2- 172.21.15.146:0/1860909627 >> v2:172.21.15.146:3300/0 conn(0x7fc7800c8bd0 0x7fc7800c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.362+0000 7fc77e800640 1 -- 172.21.15.146:0/1860909627 >> v1:172.21.15.150:6789/0 conn(0x7fc7800adcf0 legacy=0x7fc7800ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.362+0000 7fc77e800640 1 -- 172.21.15.146:0/1860909627 >> v1:172.21.15.146:6789/0 conn(0x7fc780156c50 legacy=0x7fc7800c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.362+0000 7fc77e800640 1 -- 172.21.15.146:0/1860909627 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7800ae2c0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.362+0000 7fc77ca00640 1 -- 172.21.15.146:0/1860909627 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351298476 0 0) 0x7fc7800ab130 con 0x7fc780156c50 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc77e800640 1 --2- 172.21.15.146:0/1860909627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800c8ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e60 tx=0x7fc778009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f17ce4ccb800c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc77ca00640 1 -- 172.21.15.146:0/1860909627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778007550 con 0x7fc7800c8bd0 2024-08-17T02:26:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc77ca00640 1 -- 172.21.15.146:0/1860909627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77802d050 con 0x7fc7800c8bd0 2024-08-17T02:26:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc77ca00640 1 -- 172.21.15.146:0/1860909627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780078e0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc784e00640 1 -- 172.21.15.146:0/1860909627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 msgr2=0x7fc7800c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.363+0000 7fc784e00640 1 --2- 172.21.15.146:0/1860909627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800c8ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e60 tx=0x7fc778009780 comp rx=0 tx=0).stop 2024-08-17T02:26:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.364+0000 7fc784e00640 1 -- 172.21.15.146:0/1860909627 shutdown_connections 2024-08-17T02:26:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.364+0000 7fc784e00640 1 --2- 172.21.15.146:0/1860909627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800c8ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.364+0000 7fc784e00640 1 -- 172.21.15.146:0/1860909627 >> 172.21.15.146:0/1860909627 conn(0x7fc780067750 msgr2=0x7fc7800c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.364+0000 7fc784e00640 1 -- 172.21.15.146:0/1860909627 shutdown_connections 2024-08-17T02:26:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.364+0000 7fc784e00640 1 -- 172.21.15.146:0/1860909627 wait complete. 2024-08-17T02:26:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.365+0000 7fc784e00640 1 Processor -- start 2024-08-17T02:26:29.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.365+0000 7fc784e00640 1 -- start start 2024-08-17T02:26:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7800adcf0 0x7fc780159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780156c50 0x7fc7800caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc780157bb0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78014c5f0 con 0x7fc7800adcf0 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc784e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78014c8d0 con 0x7fc780156c50 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc77d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc77d400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48354/0 (socket says 172.21.15.146:48354) 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc77de00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7800adcf0 0x7fc780159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc77d400640 1 -- 172.21.15.146:0/2090608752 learned_addr learned my addr 172.21.15.146:0/2090608752 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.366+0000 7fc77e800640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780156c50 0x7fc7800caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 -- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780156c50 msgr2=0x7fc7800caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780156c50 0x7fc7800caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 -- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7800adcf0 msgr2=0x7fc780159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7800adcf0 0x7fc780159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 -- 172.21.15.146:0/2090608752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009a20 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc77d400640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00c560 tx=0x7fc76c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011590 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c011710 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011ad0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78014cbb0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.367+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78015a0c0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.368+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc780157d60 con 0x7fc7800c8bd0 2024-08-17T02:26:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.369+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc76c01b3b0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.370+0000 7fc775600640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.370+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc76c0819b0 con 0x7fc7800c8bd0 2024-08-17T02:26:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.370+0000 7fc77de00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.371+0000 7fc77de00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 0x7fc760067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc770000c00 tx=0x7fc770007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.374+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc780157d60 con 0x7fc7800c8bd0 2024-08-17T02:26:29.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.545+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc780071050 con 0x7fc7800c8bd0 2024-08-17T02:26:29.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.546+0000 7fc775600640 1 -- 172.21.15.146:0/2090608752 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc76c017020 con 0x7fc7800c8bd0 2024-08-17T02:26:29.547 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 msgr2=0x7fc760067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 0x7fc760067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc770000c00 tx=0x7fc770007ea0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 msgr2=0x7fc7800ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00c560 tx=0x7fc76c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 shutdown_connections 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc760065150 0x7fc760067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7800c8bd0 0x7fc7800ca760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc780156c50 0x7fc7800caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 --2- 172.21.15.146:0/2090608752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7800adcf0 0x7fc780159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 >> 172.21.15.146:0/2090608752 conn(0x7fc780067750 msgr2=0x7fc780154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 shutdown_connections 2024-08-17T02:26:29.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.548+0000 7fc784e00640 1 -- 172.21.15.146:0/2090608752 wait complete. 2024-08-17T02:26:29.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.715+0000 7fd3bf200640 1 Processor -- start 2024-08-17T02:26:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.716+0000 7fd3bf200640 1 -- start start 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bf200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 0x7fd3c00ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bf200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 0x7fd3c0067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bf200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00cb580 con 0x7fd3c01567f0 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bf200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c00aeaf0 con 0x7fd3c0066cd0 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bf200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0067c20 con 0x7fd3c00ae160 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bde00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3c01567f0 0x7fd3c00cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39206/0 (socket says 172.21.15.146:39206) 2024-08-17T02:26:29.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bde00640 1 -- 172.21.15.146:0/1270149121 learned_addr learned my addr 172.21.15.146:0/1270149121 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3be800640 1 --2- 172.21.15.146:0/1270149121 >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 0x7fd3c0067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/1270149121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 0x7fd3c00ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.717+0000 7fd3bd400640 1 -- 172.21.15.146:0/1270149121 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154471257 0 0) 0x7fd3c00cb580 con 0x7fd3c01567f0 2024-08-17T02:26:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3bd400640 1 -- 172.21.15.146:0/1270149121 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a40034e0 con 0x7fd3c01567f0 2024-08-17T02:26:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3b7e00640 1 -- 172.21.15.146:0/1270149121 >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 msgr2=0x7fd3c0067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/1270149121 >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 0x7fd3c0067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3b7e00640 1 -- 172.21.15.146:0/1270149121 >> v1:172.21.15.146:6789/0 conn(0x7fd3c01567f0 legacy=0x7fd3c00cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3b7e00640 1 -- 172.21.15.146:0/1270149121 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0067650 con 0x7fd3c00ae160 2024-08-17T02:26:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.718+0000 7fd3be800640 1 --2- 172.21.15.146:0/1270149121 >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 0x7fd3c0067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.719+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/1270149121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 0x7fd3c00ae5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009850 tx=0x7fd3a80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ef6d367219c290 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.719+0000 7fd3bd400640 1 -- 172.21.15.146:0/1270149121 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a802ad00 con 0x7fd3c00ae160 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.719+0000 7fd3bd400640 1 -- 172.21.15.146:0/1270149121 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a802ae60 con 0x7fd3c00ae160 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.719+0000 7fd3bd400640 1 -- 172.21.15.146:0/1270149121 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8032670 con 0x7fd3c00ae160 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 -- 172.21.15.146:0/1270149121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 msgr2=0x7fd3c00ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 --2- 172.21.15.146:0/1270149121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 0x7fd3c00ae5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009850 tx=0x7fd3a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 -- 172.21.15.146:0/1270149121 shutdown_connections 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 --2- 172.21.15.146:0/1270149121 >> v2:172.21.15.146:3300/0 conn(0x7fd3c0066cd0 0x7fd3c0067110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 --2- 172.21.15.146:0/1270149121 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c00ae160 0x7fd3c00ae5b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 -- 172.21.15.146:0/1270149121 >> 172.21.15.146:0/1270149121 conn(0x7fd3c0067de0 msgr2=0x7fd3c00681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 -- 172.21.15.146:0/1270149121 shutdown_connections 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.720+0000 7fd3bf200640 1 -- 172.21.15.146:0/1270149121 wait complete. 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.721+0000 7fd3bf200640 1 Processor -- start 2024-08-17T02:26:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.721+0000 7fd3bf200640 1 -- start start 2024-08-17T02:26:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 0x7fd3c0149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 0x7fd3c0152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00a5a00 con 0x7fd3c00ae160 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00a5ce0 con 0x7fd3c0066cd0 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3bf200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00a5fc0 con 0x7fd3c01567f0 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.722+0000 7fd3b7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48368/0 (socket says 172.21.15.146:48368) 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 -- 172.21.15.146:0/543077197 learned_addr learned my addr 172.21.15.146:0/543077197 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3bde00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 0x7fd3c0149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3be800640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 0x7fd3c0152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 -- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 msgr2=0x7fd3c0152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 0x7fd3c0152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 -- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 msgr2=0x7fd3c0149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 0x7fd3c0149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 -- 172.21.15.146:0/543077197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8009a20 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3bde00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 0x7fd3c0149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3be800640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 0x7fd3c0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b7e00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009360 tx=0x7fd3a8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a803b6e0 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a803b840 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8009390 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.723+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a803bc00 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.724+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c00a6580 con 0x7fd3c00ae160 2024-08-17T02:26:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.725+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0071050 con 0x7fd3c00ae160 2024-08-17T02:26:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.725+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd3a8039040 con 0x7fd3c00ae160 2024-08-17T02:26:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.726+0000 7fd3b5600640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 0x7fd39c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.726+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3a8041030 con 0x7fd3c00ae160 2024-08-17T02:26:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.726+0000 7fd3bde00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 0x7fd39c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.727+0000 7fd3bde00640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 0x7fd39c067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0005840 tx=0x7fd3b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.730+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd3a80709c0 con 0x7fd3c00ae160 2024-08-17T02:26:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.905+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3c00caf20 con 0x7fd3c00ae160 2024-08-17T02:26:29.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.906+0000 7fd3b5600640 1 -- 172.21.15.146:0/543077197 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3a80370a0 con 0x7fd3c00ae160 2024-08-17T02:26:29.907 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 msgr2=0x7fd39c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 0x7fd39c067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0005840 tx=0x7fd3b0009040 comp rx=0 tx=0).stop 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 msgr2=0x7fd3c00c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009360 tx=0x7fd3a8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 shutdown_connections 2024-08-17T02:26:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd39c065180 0x7fd39c067630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3c00ae160 0x7fd3c00c7d00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3c01567f0 0x7fd3c0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 --2- 172.21.15.146:0/543077197 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3c0066cd0 0x7fd3c0149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 >> 172.21.15.146:0/543077197 conn(0x7fd3c0067de0 msgr2=0x7fd3c01531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 shutdown_connections 2024-08-17T02:26:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:29.908+0000 7fd3bf200640 1 -- 172.21.15.146:0/543077197 wait complete. 2024-08-17T02:26:29.924 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.073+0000 7f645be00640 1 Processor -- start 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.074+0000 7f645be00640 1 -- start start 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645be00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f645c0878a0 0x7f645c0b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c068d10 con 0x7f645c16a190 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645be00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c0b08d0 con 0x7f645c1695e0 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645be00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0ae2d0 con 0x7f645c0878a0 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f645c16a190 0x7f645c0691a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39222/0 (socket says 172.21.15.146:39222) 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645b400640 1 -- 172.21.15.146:0/4063313247 learned_addr learned my addr 172.21.15.146:0/4063313247 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645aa00640 1 --2- 172.21.15.146:0/4063313247 >> v2:172.21.15.150:3300/0 conn(0x7f645c0878a0 0x7f645c0b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.075+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741501543 0 0) 0x7f645c068d10 con 0x7f645c16a190 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64400034e0 con 0x7f645c16a190 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059053441 0 0) 0x7f645c0b08d0 con 0x7f645c1695e0 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f645c068d10 con 0x7f645c1695e0 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4708102 0 0) 0x7f64400034e0 con 0x7f645c16a190 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 >> v2:172.21.15.150:3300/0 conn(0x7f645c0878a0 msgr2=0x7f645c0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 --2- 172.21.15.146:0/4063313247 >> v2:172.21.15.150:3300/0 conn(0x7f645c0878a0 0x7f645c0b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.089+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 >> v1:172.21.15.150:6789/0 conn(0x7f645c1695e0 legacy=0x7f645c169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0686c0 con 0x7f645c16a190 2024-08-17T02:26:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f64540017f0 con 0x7f645c16a190 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 >> v1:172.21.15.146:6789/0 conn(0x7f645c16a190 legacy=0x7f645c0691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f64400061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6440006830 0x7f6440006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6440007310 0x7f64400077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440007fc0 con 0x7f6440003dc0 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440008130 con 0x7f6440007310 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6440010840 con 0x7f6440006830 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f64400061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645b400640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6440007310 0x7f64400077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f6453e00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6440006830 0x7f6440006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 -- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6440006830 msgr2=0x7f6440006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6440006830 0x7f6440006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 -- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6440007310 msgr2=0x7f64400077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6440007310 0x7f64400077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645aa00640 1 -- 172.21.15.146:0/4063313247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400034e0 con 0x7f6440003dc0 2024-08-17T02:26:30.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f645b400640 1 -- 172.21.15.146:0/4063313247 reap_dead start 2024-08-17T02:26:30.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.090+0000 7f6453e00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6440006830 0x7f6440006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.091+0000 7f645aa00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f64400061c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f644c009b70 tx=0x7f644c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d582f597bb8b3170 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c031400 con 0x7f6440003dc0 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c02d050 con 0x7f6440003dc0 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645a000640 1 -- 172.21.15.146:0/4063313247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c031790 con 0x7f6440003dc0 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 -- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 msgr2=0x7f64400061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f64400061c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f644c009b70 tx=0x7f644c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 -- 172.21.15.146:0/4063313247 shutdown_connections 2024-08-17T02:26:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 --2- 172.21.15.146:0/4063313247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f64400061c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 -- 172.21.15.146:0/4063313247 >> 172.21.15.146:0/4063313247 conn(0x7f645c0cb790 msgr2=0x7f645c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 -- 172.21.15.146:0/4063313247 shutdown_connections 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.092+0000 7f645be00640 1 -- 172.21.15.146:0/4063313247 wait complete. 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.094+0000 7f645be00640 1 Processor -- start 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.094+0000 7f645be00640 1 -- start start 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f645c161990 0x7f645c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c162d80 0x7f645c1631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c163730 con 0x7f6440003dc0 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c160270 con 0x7f645c162d80 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15f6e0 con 0x7f645c161990 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48388/0 (socket says 172.21.15.146:48388) 2024-08-17T02:26:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 -- 172.21.15.146:0/2435115585 learned_addr learned my addr 172.21.15.146:0/2435115585 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645b400640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c162d80 0x7f645c1631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f6453e00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f645c161990 0x7f645c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 -- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f645c161990 msgr2=0x7f645c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f645c161990 0x7f645c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 -- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c162d80 msgr2=0x7f645c1631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c162d80 0x7f645c1631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.095+0000 7f645aa00640 1 -- 172.21.15.146:0/2435115585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c15f940 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f645aa00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f644c009b70 tx=0x7f644c035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c030850 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c0309b0 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c030d70 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c15fc20 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.096+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c15e070 con 0x7f6440003dc0 2024-08-17T02:26:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.097+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c1600a0 con 0x7f6440003dc0 2024-08-17T02:26:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.098+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f644c045620 con 0x7f6440003dc0 2024-08-17T02:26:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.099+0000 7f6452000640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 0x7f6438067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.099+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f644c0a3650 con 0x7f6440003dc0 2024-08-17T02:26:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.099+0000 7f6453e00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 0x7f6438067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.100+0000 7f6453e00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 0x7f6438067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6444001200 tx=0x7f6444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.102+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f644c071670 con 0x7f6440003dc0 2024-08-17T02:26:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.276+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f645c071050 con 0x7f6440003dc0 2024-08-17T02:26:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.277+0000 7f6452000640 1 -- 172.21.15.146:0/2435115585 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f644c074c90 con 0x7f6440003dc0 2024-08-17T02:26:30.279 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:30.279 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.279+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 msgr2=0x7f6438067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.279+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 0x7f6438067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6444001200 tx=0x7f6444009040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.279+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 msgr2=0x7f645c0cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f644c009b70 tx=0x7f644c035000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 shutdown_connections 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6438065150 0x7f6438067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f645c162d80 0x7f645c1631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f645c161990 0x7f645c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 --2- 172.21.15.146:0/2435115585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6440003dc0 0x7f645c0cac10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 >> 172.21.15.146:0/2435115585 conn(0x7f645c0cb790 msgr2=0x7f645c0690a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 shutdown_connections 2024-08-17T02:26:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.280+0000 7f645be00640 1 -- 172.21.15.146:0/2435115585 wait complete. 2024-08-17T02:26:30.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:30.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:30.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.447+0000 7fca24a00640 1 Processor -- start 2024-08-17T02:26:30.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.447+0000 7fca24a00640 1 -- start start 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.448+0000 7fca24a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca20158fb0 0x7fca200cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.448+0000 7fca24a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200caa80 0x7fca200c7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.448+0000 7fca24a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca200caec0 con 0x7fca200cf800 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.448+0000 7fca24a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca200c6e70 con 0x7fca20158fb0 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.448+0000 7fca24a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20159380 con 0x7fca200caa80 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca20158fb0 0x7fca200cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca20158fb0 0x7fca200cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48390/0 (socket says 172.21.15.146:48390) 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 -- 172.21.15.146:0/1850680603 learned_addr learned my addr 172.21.15.146:0/1850680603 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1e800640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200caa80 0x7fca200c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 -- 172.21.15.146:0/1850680603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200caa80 msgr2=0x7fca200c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200caa80 0x7fca200c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 -- 172.21.15.146:0/1850680603 >> v1:172.21.15.150:6789/0 conn(0x7fca200cf800 legacy=0x7fca200ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.449+0000 7fca1de00640 1 -- 172.21.15.146:0/1850680603 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200cb100 con 0x7fca20158fb0 2024-08-17T02:26:30.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.450+0000 7fca1de00640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20158fb0 0x7fca200cf2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca2006f620 tx=0x7fca100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9f2ff5878fd09b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.450+0000 7fca1ca00640 1 -- 172.21.15.146:0/1850680603 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1002ae20 con 0x7fca20158fb0 2024-08-17T02:26:30.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.450+0000 7fca1ca00640 1 -- 172.21.15.146:0/1850680603 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10032440 con 0x7fca20158fb0 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.450+0000 7fca1ca00640 1 -- 172.21.15.146:0/1850680603 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10032820 con 0x7fca20158fb0 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 -- 172.21.15.146:0/1850680603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20158fb0 msgr2=0x7fca200cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20158fb0 0x7fca200cf2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca2006f620 tx=0x7fca100091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 -- 172.21.15.146:0/1850680603 shutdown_connections 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200caa80 0x7fca200c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 --2- 172.21.15.146:0/1850680603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca20158fb0 0x7fca200cf2c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 -- 172.21.15.146:0/1850680603 >> 172.21.15.146:0/1850680603 conn(0x7fca200cfdd0 msgr2=0x7fca200d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 -- 172.21.15.146:0/1850680603 shutdown_connections 2024-08-17T02:26:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.451+0000 7fca24a00640 1 -- 172.21.15.146:0/1850680603 wait complete. 2024-08-17T02:26:30.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.452+0000 7fca24a00640 1 Processor -- start 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.452+0000 7fca24a00640 1 -- start start 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 0x7fca200b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 0x7fca2009ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b4760 con 0x7fca200caa80 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b3b50 con 0x7fca20158fb0 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca24a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b3e30 con 0x7fca200cf800 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca1de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca1de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48398/0 (socket says 172.21.15.146:48398) 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.453+0000 7fca1de00640 1 -- 172.21.15.146:0/3862684718 learned_addr learned my addr 172.21.15.146:0/3862684718 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1e800640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 0x7fca2009ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1d400640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 0x7fca200b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 -- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 msgr2=0x7fca200b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 0x7fca200b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 -- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 msgr2=0x7fca2009ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 0x7fca2009ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 -- 172.21.15.146:0/3862684718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10009450 con 0x7fca200caa80 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1e800640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 0x7fca2009ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1d400640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 0x7fca200b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca1de00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca10035040 tx=0x7fca10032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10000d10 con 0x7fca200caa80 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10031de0 con 0x7fca200caa80 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1003d670 con 0x7fca200caa80 2024-08-17T02:26:30.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.454+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca200b4110 con 0x7fca200caa80 2024-08-17T02:26:30.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.455+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2009cfd0 con 0x7fca200caa80 2024-08-17T02:26:30.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.456+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20064db0 con 0x7fca200caa80 2024-08-17T02:26:30.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.456+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fca10039040 con 0x7fca200caa80 2024-08-17T02:26:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.458+0000 7fca15600640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 0x7fca00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.458+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca100a22c0 con 0x7fca200caa80 2024-08-17T02:26:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.458+0000 7fca1d400640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 0x7fca00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.458+0000 7fca1d400640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 0x7fca00067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca2009c460 tx=0x7fca0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.462+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fca10070380 con 0x7fca200caa80 2024-08-17T02:26:30.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.634+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca200caec0 con 0x7fca200caa80 2024-08-17T02:26:30.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.634+0000 7fca15600640 1 -- 172.21.15.146:0/3862684718 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca200caec0 con 0x7fca200caa80 2024-08-17T02:26:30.635 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:30.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 msgr2=0x7fca00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 0x7fca00067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca2009c460 tx=0x7fca0c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 msgr2=0x7fca200b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca10035040 tx=0x7fca10032000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 shutdown_connections 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fca00065150 0x7fca00067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fca20158fb0 0x7fca2009ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fca200cf800 0x7fca200b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 --2- 172.21.15.146:0/3862684718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200caa80 0x7fca200b4bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 >> 172.21.15.146:0/3862684718 conn(0x7fca200cfdd0 msgr2=0x7fca20067580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 shutdown_connections 2024-08-17T02:26:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.636+0000 7fca24a00640 1 -- 172.21.15.146:0/3862684718 wait complete. 2024-08-17T02:26:30.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:30.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.804+0000 7f81de600640 1 Processor -- start 2024-08-17T02:26:30.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.804+0000 7f81de600640 1 -- start start 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81de600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81d8158ea0 0x7f81d80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81de600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81d80caa00 0x7f81d80c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81de600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d806f240 con 0x7f81d80d09a0 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81de600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80c6f20 con 0x7f81d8158ea0 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81de600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80cf410 con 0x7f81d80caa00 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81d7400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81d8158ea0 0x7f81d80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81d7400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81d8158ea0 0x7f81d80d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48404/0 (socket says 172.21.15.146:48404) 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.805+0000 7f81d7400640 1 -- 172.21.15.146:0/3776740899 learned_addr learned my addr 172.21.15.146:0/3776740899 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.806+0000 7f81d7e00640 1 --2- 172.21.15.146:0/3776740899 >> v2:172.21.15.150:3300/0 conn(0x7f81d80caa00 0x7f81d80c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.806+0000 7f81d7400640 1 -- 172.21.15.146:0/3776740899 >> v2:172.21.15.150:3300/0 conn(0x7f81d80caa00 msgr2=0x7f81d80c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.806+0000 7f81d7400640 1 --2- 172.21.15.146:0/3776740899 >> v2:172.21.15.150:3300/0 conn(0x7f81d80caa00 0x7f81d80c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.806+0000 7f81d7400640 1 -- 172.21.15.146:0/3776740899 >> v1:172.21.15.150:6789/0 conn(0x7f81d80d09a0 legacy=0x7f81d80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.806+0000 7f81d7400640 1 -- 172.21.15.146:0/3776740899 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80ceb70 con 0x7f81d8158ea0 2024-08-17T02:26:30.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.807+0000 7f81d7400640 1 --2- 172.21.15.146:0/3776740899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d8158ea0 0x7f81d80d0460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c3750 tx=0x7f81c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df031a930d98edd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.807+0000 7f81d6000640 1 -- 172.21.15.146:0/3776740899 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c802add0 con 0x7f81d8158ea0 2024-08-17T02:26:30.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.807+0000 7f81d6000640 1 -- 172.21.15.146:0/3776740899 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8032440 con 0x7f81d8158ea0 2024-08-17T02:26:30.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.807+0000 7f81d6000640 1 -- 172.21.15.146:0/3776740899 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8032820 con 0x7f81d8158ea0 2024-08-17T02:26:30.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 -- 172.21.15.146:0/3776740899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d8158ea0 msgr2=0x7f81d80d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 --2- 172.21.15.146:0/3776740899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d8158ea0 0x7f81d80d0460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c3750 tx=0x7f81c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 -- 172.21.15.146:0/3776740899 shutdown_connections 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 --2- 172.21.15.146:0/3776740899 >> v2:172.21.15.150:3300/0 conn(0x7f81d80caa00 0x7f81d80c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 --2- 172.21.15.146:0/3776740899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d8158ea0 0x7f81d80d0460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 -- 172.21.15.146:0/3776740899 >> 172.21.15.146:0/3776740899 conn(0x7f81d806eb90 msgr2=0x7f81d80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 -- 172.21.15.146:0/3776740899 shutdown_connections 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.808+0000 7f81de600640 1 -- 172.21.15.146:0/3776740899 wait complete. 2024-08-17T02:26:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.809+0000 7f81de600640 1 Processor -- start 2024-08-17T02:26:30.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.809+0000 7f81de600640 1 -- start start 2024-08-17T02:26:30.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81d80caa00 0x7f81d81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81d8158ea0 0x7f81d8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d809ce60 con 0x7f81d80d09a0 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d809c250 con 0x7f81d8158ea0 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81de600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d809c530 con 0x7f81d80caa00 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.810+0000 7f81d6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48412/0 (socket says 172.21.15.146:48412) 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 -- 172.21.15.146:0/1699114553 learned_addr learned my addr 172.21.15.146:0/1699114553 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d7400640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81d80caa00 0x7f81d81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d7e00640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81d8158ea0 0x7f81d8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 -- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81d80caa00 msgr2=0x7f81d81571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81d80caa00 0x7f81d81571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 -- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81d8158ea0 msgr2=0x7f81d8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81d8158ea0 0x7f81d8158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 -- 172.21.15.146:0/1699114553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009450 con 0x7f81d80d09a0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81d6a00640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c560 tx=0x7f81c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011590 con 0x7f81d80d09a0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4011710 con 0x7f81d80d09a0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4011ad0 con 0x7f81d80d09a0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.811+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d809c810 con 0x7f81d80d09a0 2024-08-17T02:26:30.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.812+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d81576f0 con 0x7f81d80d09a0 2024-08-17T02:26:30.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.813+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d809cfd0 con 0x7f81d80d09a0 2024-08-17T02:26:30.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.813+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f81c401b3b0 con 0x7f81d80d09a0 2024-08-17T02:26:30.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.814+0000 7f81cea00640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 0x7f81b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:30.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.814+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81c40819e0 con 0x7f81d80d09a0 2024-08-17T02:26:30.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.814+0000 7f81d7400640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 0x7f81b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:30.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.815+0000 7f81d7400640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 0x7f81b8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81c8034000 tx=0x7f81c8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.818+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f81c404fab0 con 0x7f81d80d09a0 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.994+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81d8071050 con 0x7f81d80d09a0 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.995+0000 7f81cea00640 1 -- 172.21.15.146:0/1699114553 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81c4017020 con 0x7f81d80d09a0 2024-08-17T02:26:30.996 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 msgr2=0x7f81b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 0x7f81b8067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81c8034000 tx=0x7f81c8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 msgr2=0x7f81d8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81c400c560 tx=0x7f81c4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 shutdown_connections 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f81b8065150 0x7f81b8067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d80d09a0 0x7f81d8157cc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81d8158ea0 0x7f81d8158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 --2- 172.21.15.146:0/1699114553 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81d80caa00 0x7f81d81571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:30.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 >> 172.21.15.146:0/1699114553 conn(0x7f81d806eb90 msgr2=0x7f81d80b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 shutdown_connections 2024-08-17T02:26:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:30.997+0000 7f81de600640 1 -- 172.21.15.146:0/1699114553 wait complete. 2024-08-17T02:26:31.014 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.182+0000 7f8d95800640 1 Processor -- start 2024-08-17T02:26:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.182+0000 7f8d95800640 1 -- start start 2024-08-17T02:26:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d95800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d900c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d95800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d901598f0 con 0x7f8d90155a80 2024-08-17T02:26:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d95800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d90159bd0 con 0x7f8d90155e50 2024-08-17T02:26:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d95800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90159eb0 con 0x7f8d900c7db0 2024-08-17T02:26:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d8ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d90155a80 0x7f8d9006dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39232/0 (socket says 172.21.15.146:39232) 2024-08-17T02:26:31.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.183+0000 7f8d8ea00640 1 -- 172.21.15.146:0/2937802916 learned_addr learned my addr 172.21.15.146:0/2937802916 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:31.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d87e00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d900c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221802151 0 0) 0x7f8d901598f0 con 0x7f8d90155a80 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d740034e0 con 0x7f8d90155a80 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151675272 0 0) 0x7f8d740034e0 con 0x7f8d90155a80 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 msgr2=0x7f8d900c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d900c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 >> v1:172.21.15.150:6789/0 conn(0x7f8d90155e50 legacy=0x7f8d900aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9015a190 con 0x7f8d90155a80 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f8d80001470 con 0x7f8d90155a80 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 >> v1:172.21.15.146:6789/0 conn(0x7f8d90155a80 legacy=0x7f8d9006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d74003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d74003f80 0x7f8d74004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d74004cc0 0x7f8d74005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90159eb0 con 0x7f8d74003f80 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400bb60 con 0x7f8d74004cc0 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400bd20 con 0x7f8d900c7db0 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.184+0000 7f8d87e00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d74003f80 0x7f8d74004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d8ea00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d74003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d8f400640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d74004cc0 0x7f8d74005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d87e00640 1 -- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 msgr2=0x7f8d74003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d87e00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900c7db0 0x7f8d74003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d87e00640 1 -- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d74004cc0 msgr2=0x7f8d74005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d87e00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d74004cc0 0x7f8d74005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d87e00640 1 -- 172.21.15.146:0/2937802916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740034e0 con 0x7f8d74003f80 2024-08-17T02:26:31.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.185+0000 7f8d8f400640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d74004cc0 0x7f8d74005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:31.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.186+0000 7f8d87e00640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d74003f80 0x7f8d74004780 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006e70 tx=0x7f8d7800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fd89cd3acf59a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.186+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7802dc80 con 0x7f8d74003f80 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.186+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7802dde0 con 0x7f8d74003f80 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.186+0000 7f8d8e000640 1 -- 172.21.15.146:0/2937802916 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78035650 con 0x7f8d74003f80 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 -- 172.21.15.146:0/2937802916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d74003f80 msgr2=0x7f8d74004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 --2- 172.21.15.146:0/2937802916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d74003f80 0x7f8d74004780 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006e70 tx=0x7f8d7800b3b0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d8f400640 1 -- 172.21.15.146:0/2937802916 reap_dead start 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 -- 172.21.15.146:0/2937802916 shutdown_connections 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 -- 172.21.15.146:0/2937802916 >> 172.21.15.146:0/2937802916 conn(0x7f8d90067750 msgr2=0x7f8d900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 -- 172.21.15.146:0/2937802916 shutdown_connections 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.187+0000 7f8d95800640 1 -- 172.21.15.146:0/2937802916 wait complete. 2024-08-17T02:26:31.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.188+0000 7f8d95800640 1 Processor -- start 2024-08-17T02:26:31.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.188+0000 7f8d95800640 1 -- start start 2024-08-17T02:26:31.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d74003f80 0x7f8d90153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90157120 0x7f8d901494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90068b50 con 0x7f8d901541b0 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9014ea10 con 0x7f8d90157120 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d95800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9014de00 con 0x7f8d74003f80 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.189+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48438/0 (socket says 172.21.15.146:48438) 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d8ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d74003f80 0x7f8d90153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 -- 172.21.15.146:0/1814292022 learned_addr learned my addr 172.21.15.146:0/1814292022 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d8f400640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90157120 0x7f8d901494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 -- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d74003f80 msgr2=0x7f8d90153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d74003f80 0x7f8d90153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 -- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90157120 msgr2=0x7f8d901494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90157120 0x7f8d901494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 -- 172.21.15.146:0/1814292022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9014e0e0 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d87e00640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800be40 tx=0x7f8d78038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7803d6a0 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7803d800 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.190+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9014e3c0 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.191+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7803dbc0 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.191+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d90149a30 con 0x7f8d901541b0 2024-08-17T02:26:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.192+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d90071050 con 0x7f8d901541b0 2024-08-17T02:26:31.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.192+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d7803c070 con 0x7f8d901541b0 2024-08-17T02:26:31.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.193+0000 7f8d86000640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 0x7f8d6c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.193+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d780a2c40 con 0x7f8d901541b0 2024-08-17T02:26:31.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.193+0000 7f8d8ea00640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 0x7f8d6c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.194+0000 7f8d8ea00640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 0x7f8d6c067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001ce0 tx=0x7f8d80001e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.197+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d78070dd0 con 0x7f8d901541b0 2024-08-17T02:26:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.371+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d9014eb50 con 0x7f8d901541b0 2024-08-17T02:26:31.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.372+0000 7f8d86000640 1 -- 172.21.15.146:0/1814292022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d7803a0a0 con 0x7f8d901541b0 2024-08-17T02:26:31.373 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 msgr2=0x7f8d6c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 0x7f8d6c067630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001ce0 tx=0x7f8d80001e50 comp rx=0 tx=0).stop 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 msgr2=0x7f8d90156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800be40 tx=0x7f8d78038000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 shutdown_connections 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8d6c065180 0x7f8d6c067630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901541b0 0x7f8d90156be0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90157120 0x7f8d901494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 --2- 172.21.15.146:0/1814292022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d74003f80 0x7f8d90153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 >> 172.21.15.146:0/1814292022 conn(0x7f8d90067750 msgr2=0x7f8d900a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 shutdown_connections 2024-08-17T02:26:31.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.374+0000 7f8d95800640 1 -- 172.21.15.146:0/1814292022 wait complete. 2024-08-17T02:26:31.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.538+0000 7ff635000640 1 Processor -- start 2024-08-17T02:26:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.538+0000 7ff635000640 1 -- start start 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff635000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff630158bd0 0x7ff630069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff635000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 0x7ff6300ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff635000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6300aec20 con 0x7ff6300ac540 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff635000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6300699c0 con 0x7ff630158bd0 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff635000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6300ae330 con 0x7ff630069540 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff62f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff630158bd0 0x7ff630069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff62f400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff630158bd0 0x7ff630069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48440/0 (socket says 172.21.15.146:48440) 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff62f400640 1 -- 172.21.15.146:0/3319244531 learned_addr learned my addr 172.21.15.146:0/3319244531 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.539+0000 7ff626a00640 1 --2- 172.21.15.146:0/3319244531 >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 0x7ff6300ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.540+0000 7ff62f400640 1 -- 172.21.15.146:0/3319244531 >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 msgr2=0x7ff6300ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.540+0000 7ff62f400640 1 --2- 172.21.15.146:0/3319244531 >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 0x7ff6300ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.540+0000 7ff62f400640 1 -- 172.21.15.146:0/3319244531 >> v1:172.21.15.150:6789/0 conn(0x7ff6300ac540 legacy=0x7ff630067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.540+0000 7ff62f400640 1 -- 172.21.15.146:0/3319244531 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300acd30 con 0x7ff630158bd0 2024-08-17T02:26:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.540+0000 7ff626a00640 1 --2- 172.21.15.146:0/3319244531 >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 0x7ff6300ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff62f400640 1 --2- 172.21.15.146:0/3319244531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630069000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6300cd8e0 tx=0x7ff6200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7048537577d0387 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff62ea00640 1 -- 172.21.15.146:0/3319244531 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62002adf0 con 0x7ff630158bd0 2024-08-17T02:26:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff62ea00640 1 -- 172.21.15.146:0/3319244531 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620032440 con 0x7ff630158bd0 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff62ea00640 1 -- 172.21.15.146:0/3319244531 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620032820 con 0x7ff630158bd0 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff635000640 1 -- 172.21.15.146:0/3319244531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 msgr2=0x7ff630069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.541+0000 7ff635000640 1 --2- 172.21.15.146:0/3319244531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630069000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6300cd8e0 tx=0x7ff6200091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 -- 172.21.15.146:0/3319244531 shutdown_connections 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 --2- 172.21.15.146:0/3319244531 >> v2:172.21.15.150:3300/0 conn(0x7ff630069540 0x7ff6300ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 --2- 172.21.15.146:0/3319244531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630069000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 -- 172.21.15.146:0/3319244531 >> 172.21.15.146:0/3319244531 conn(0x7ff630096a70 msgr2=0x7ff6300cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 -- 172.21.15.146:0/3319244531 shutdown_connections 2024-08-17T02:26:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.542+0000 7ff635000640 1 -- 172.21.15.146:0/3319244531 wait complete. 2024-08-17T02:26:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.543+0000 7ff635000640 1 Processor -- start 2024-08-17T02:26:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.543+0000 7ff635000640 1 -- start start 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff630069540 0x7ff63015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6300ac540 0x7ff6300c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63015b380 con 0x7ff630158bd0 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63015a1d0 con 0x7ff6300ac540 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff635000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6300b0af0 con 0x7ff630069540 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff62fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff62fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48454/0 (socket says 172.21.15.146:48454) 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff62fe00640 1 -- 172.21.15.146:0/50553897 learned_addr learned my addr 172.21.15.146:0/50553897 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff62f400640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff630069540 0x7ff63015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.544+0000 7ff626a00640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6300ac540 0x7ff6300c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 -- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff630069540 msgr2=0x7ff63015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff630069540 0x7ff63015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 -- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6300ac540 msgr2=0x7ff6300c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6300ac540 0x7ff6300c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 -- 172.21.15.146:0/50553897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620009450 con 0x7ff630158bd0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff62fe00640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c860 tx=0x7ff628001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62800ce50 con 0x7ff630158bd0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62800a850 con 0x7ff630158bd0 2024-08-17T02:26:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6300b0dd0 con 0x7ff630158bd0 2024-08-17T02:26:31.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62800ac10 con 0x7ff630158bd0 2024-08-17T02:26:31.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.545+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6300b1670 con 0x7ff630158bd0 2024-08-17T02:26:31.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.546+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6300b1890 con 0x7ff630158bd0 2024-08-17T02:26:31.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.547+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff628012420 con 0x7ff630158bd0 2024-08-17T02:26:31.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.548+0000 7ff627400640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 0x7ff60c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.548+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6280825e0 con 0x7ff630158bd0 2024-08-17T02:26:31.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.548+0000 7ff62f400640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 0x7ff60c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.549+0000 7ff62f400640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 0x7ff60c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff620034000 tx=0x7ff620032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.552+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff628050750 con 0x7ff630158bd0 2024-08-17T02:26:31.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.728+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff630071050 con 0x7ff630158bd0 2024-08-17T02:26:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.730+0000 7ff627400640 1 -- 172.21.15.146:0/50553897 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff628053d70 con 0x7ff630158bd0 2024-08-17T02:26:31.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:31.731 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.732+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 msgr2=0x7ff60c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.732+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 0x7ff60c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff620034000 tx=0x7ff620032000 comp rx=0 tx=0).stop 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.732+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 msgr2=0x7ff630067d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.732+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c860 tx=0x7ff628001690 comp rx=0 tx=0).stop 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 shutdown_connections 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff60c065150 0x7ff60c067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff630158bd0 0x7ff630067d60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6300ac540 0x7ff6300c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 --2- 172.21.15.146:0/50553897 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff630069540 0x7ff63015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 >> 172.21.15.146:0/50553897 conn(0x7ff630096a70 msgr2=0x7ff6300ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 shutdown_connections 2024-08-17T02:26:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.733+0000 7ff635000640 1 -- 172.21.15.146:0/50553897 wait complete. 2024-08-17T02:26:31.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:31.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:31.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.903+0000 7f65b2e00640 1 Processor -- start 2024-08-17T02:26:31.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.903+0000 7f65b2e00640 1 -- start start 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.904+0000 7f65b2e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65ac0b0a80 0x7f65ac0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.904+0000 7f65b2e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 0x7f65ac15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.904+0000 7f65b2e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac157070 con 0x7f65ac157e10 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.904+0000 7f65b2e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0b1390 con 0x7f65ac0b0a80 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.904+0000 7f65b2e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac15b410 con 0x7f65ac0adec0 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65abe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65ac0b0a80 0x7f65ac0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65a3400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f65ac157e10 0x7f65ac0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39234/0 (socket says 172.21.15.146:39234) 2024-08-17T02:26:31.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65a3400640 1 -- 172.21.15.146:0/2080683506 learned_addr learned my addr 172.21.15.146:0/2080683506 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65b0e00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 0x7f65ac15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65abe00640 1 -- 172.21.15.146:0/2080683506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 msgr2=0x7f65ac15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65abe00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 0x7f65ac15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65abe00640 1 -- 172.21.15.146:0/2080683506 >> v1:172.21.15.146:6789/0 conn(0x7f65ac157e10 legacy=0x7f65ac0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65abe00640 1 -- 172.21.15.146:0/2080683506 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac157330 con 0x7f65ac0b0a80 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65ab400640 1 -- 172.21.15.146:0/2080683506 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442391424 0 0) 0x7f65ac157070 con 0x7f65ac157e10 2024-08-17T02:26:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.905+0000 7f65b0e00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 0x7f65ac15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.906+0000 7f65abe00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac0b0e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e60 tx=0x7f659c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf038716a5316b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.906+0000 7f65ab400640 1 -- 172.21.15.146:0/2080683506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c007550 con 0x7f65ac0b0a80 2024-08-17T02:26:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.906+0000 7f65ab400640 1 -- 172.21.15.146:0/2080683506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c02d050 con 0x7f65ac0b0a80 2024-08-17T02:26:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.906+0000 7f65ab400640 1 -- 172.21.15.146:0/2080683506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0078e0 con 0x7f65ac0b0a80 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 -- 172.21.15.146:0/2080683506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 msgr2=0x7f65ac0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac0b0e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f659c009e60 tx=0x7f659c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 -- 172.21.15.146:0/2080683506 shutdown_connections 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac0adec0 0x7f65ac15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 --2- 172.21.15.146:0/2080683506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac0b0e50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 -- 172.21.15.146:0/2080683506 >> 172.21.15.146:0/2080683506 conn(0x7f65ac067750 msgr2=0x7f65ac0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 -- 172.21.15.146:0/2080683506 shutdown_connections 2024-08-17T02:26:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.907+0000 7f65b2e00640 1 -- 172.21.15.146:0/2080683506 wait complete. 2024-08-17T02:26:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.908+0000 7f65b2e00640 1 Processor -- start 2024-08-17T02:26:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.909+0000 7f65b2e00640 1 -- start start 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.909+0000 7f65b2e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0adec0 0x7f65ac1690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.909+0000 7f65b2e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65b2e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac157e10 0x7f65ac159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65b2e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14f980 con 0x7f65ac0b0a80 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65b2e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14ff40 con 0x7f65ac0adec0 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65b2e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14f220 con 0x7f65ac157e10 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48466/0 (socket says 172.21.15.146:48466) 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 -- 172.21.15.146:0/3490440060 learned_addr learned my addr 172.21.15.146:0/3490440060 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 -- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac157e10 msgr2=0x7f65ac159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac157e10 0x7f65ac159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 -- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0adec0 msgr2=0x7f65ac1690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0adec0 0x7f65ac1690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 -- 172.21.15.146:0/3490440060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009a20 con 0x7f65ac0b0a80 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.910+0000 7f65a3400640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f659400c610 tx=0x7f6594007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.911+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594005aa0 con 0x7f65ac0b0a80 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.911+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594005c00 con 0x7f65ac0b0a80 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.911+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940070f0 con 0x7f65ac0b0a80 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.911+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac14f500 con 0x7f65ac0b0a80 2024-08-17T02:26:31.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.911+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac169620 con 0x7f65ac0b0a80 2024-08-17T02:26:31.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.912+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac06a610 con 0x7f65ac0b0a80 2024-08-17T02:26:31.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.913+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65940074a0 con 0x7f65ac0b0a80 2024-08-17T02:26:31.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.913+0000 7f65a3e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 0x7f6588067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:31.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.914+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6594081e40 con 0x7f65ac0b0a80 2024-08-17T02:26:31.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.914+0000 7f65abe00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 0x7f6588067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:31.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.915+0000 7f65abe00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 0x7f6588067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c034000 tx=0x7f659c037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:31.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:31.918+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65ac06a610 con 0x7f65ac0b0a80 2024-08-17T02:26:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.089+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65ac06a610 con 0x7f65ac0b0a80 2024-08-17T02:26:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.089+0000 7f65a3e00640 1 -- 172.21.15.146:0/3490440060 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65ac06a610 con 0x7f65ac0b0a80 2024-08-17T02:26:32.091 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 msgr2=0x7f6588067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 0x7f6588067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c034000 tx=0x7f659c037000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 msgr2=0x7f65ac1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f659400c610 tx=0x7f6594007d60 comp rx=0 tx=0).stop 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 shutdown_connections 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6588065150 0x7f6588067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65ac0b0a80 0x7f65ac1596c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f65ac157e10 0x7f65ac159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 --2- 172.21.15.146:0/3490440060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65ac0adec0 0x7f65ac1690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 >> 172.21.15.146:0/3490440060 conn(0x7f65ac067750 msgr2=0x7f65ac0cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.091+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 shutdown_connections 2024-08-17T02:26:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.092+0000 7f65b2e00640 1 -- 172.21.15.146:0/3490440060 wait complete. 2024-08-17T02:26:32.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:32.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.257+0000 7f9285400640 1 Processor -- start 2024-08-17T02:26:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.257+0000 7f9285400640 1 -- start start 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9285400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 0x7f92800c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9285400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92800adcf0 0x7f92800ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9285400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800ab130 con 0x7f92800abb00 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9285400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800ae5a0 con 0x7f92800adcf0 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9285400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92800ae2c0 con 0x7f9280156c50 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f927f200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f92800abb00 0x7f92800c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39244/0 (socket says 172.21.15.146:39244) 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f927f200640 1 -- 172.21.15.146:0/3652135790 learned_addr learned my addr 172.21.15.146:0/3652135790 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f927e800640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 0x7f92800c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f9275e00640 1 --2- 172.21.15.146:0/3652135790 >> v2:172.21.15.150:3300/0 conn(0x7f92800adcf0 0x7f92800ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.259+0000 7f927de00640 1 -- 172.21.15.146:0/3652135790 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321819990 0 0) 0x7f92800ab130 con 0x7f92800abb00 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f927de00640 1 -- 172.21.15.146:0/3652135790 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92640034e0 con 0x7f92800abb00 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f9275e00640 1 -- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 msgr2=0x7f92800c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f9275e00640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 0x7f92800c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f9275e00640 1 -- 172.21.15.146:0/3652135790 >> v1:172.21.15.146:6789/0 conn(0x7f92800abb00 legacy=0x7f92800c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f9275e00640 1 -- 172.21.15.146:0/3652135790 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800aaae0 con 0x7f92800adcf0 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.260+0000 7f927e800640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 0x7f92800c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.261+0000 7f9275e00640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92800ab5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f92680090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5941d7edfe8896f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.261+0000 7f927de00640 1 -- 172.21.15.146:0/3652135790 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926802ad00 con 0x7f92800adcf0 2024-08-17T02:26:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.261+0000 7f927de00640 1 -- 172.21.15.146:0/3652135790 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926802ae60 con 0x7f92800adcf0 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.261+0000 7f927de00640 1 -- 172.21.15.146:0/3652135790 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268032670 con 0x7f92800adcf0 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 -- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 msgr2=0x7f92800ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92800ab5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9268009850 tx=0x7f92680090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 -- 172.21.15.146:0/3652135790 shutdown_connections 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92800ab5c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 --2- 172.21.15.146:0/3652135790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9280156c50 0x7f92800c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 -- 172.21.15.146:0/3652135790 >> 172.21.15.146:0/3652135790 conn(0x7f9280067750 msgr2=0x7f92800c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 -- 172.21.15.146:0/3652135790 shutdown_connections 2024-08-17T02:26:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.262+0000 7f9285400640 1 -- 172.21.15.146:0/3652135790 wait complete. 2024-08-17T02:26:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.263+0000 7f9285400640 1 Processor -- start 2024-08-17T02:26:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.264+0000 7f9285400640 1 -- start start 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.264+0000 7f9285400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92800abb00 0x7f92800a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f9285400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92801500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f9285400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f9285400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280153070 con 0x7f9280156c50 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f9285400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280151220 con 0x7f92800adcf0 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f9285400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92801673a0 con 0x7f92800abb00 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48478/0 (socket says 172.21.15.146:48478) 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 -- 172.21.15.146:0/2749940693 learned_addr learned my addr 172.21.15.146:0/2749940693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 -- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92800abb00 msgr2=0x7f92800a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92800abb00 0x7f92800a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 -- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 msgr2=0x7f92801500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92801500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 -- 172.21.15.146:0/2749940693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009390 con 0x7f9280156c50 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.265+0000 7f927f200640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f927800cc70 tx=0x7f9278001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.266+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800ce90 con 0x7f9280156c50 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.266+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9268009390 con 0x7f9280156c50 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.266+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800a850 con 0x7f9280156c50 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.266+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800ac10 con 0x7f9280156c50 2024-08-17T02:26:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.266+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280167960 con 0x7f9280156c50 2024-08-17T02:26:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.267+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280071050 con 0x7f9280156c50 2024-08-17T02:26:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.268+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9278007300 con 0x7f9280156c50 2024-08-17T02:26:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.269+0000 7f9276a00640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 0x7f925c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.269+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9278082570 con 0x7f9280156c50 2024-08-17T02:26:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.269+0000 7f927e800640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 0x7f925c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.269+0000 7f927e800640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 0x7f925c067630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9270009c30 tx=0x7f92700090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.272+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f92780506b0 con 0x7f9280156c50 2024-08-17T02:26:32.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.446+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9280151360 con 0x7f9280156c50 2024-08-17T02:26:32.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.447+0000 7f9276a00640 1 -- 172.21.15.146:0/2749940693 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9278053cd0 con 0x7f9280156c50 2024-08-17T02:26:32.448 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:32.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 msgr2=0x7f925c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 0x7f925c067630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9270009c30 tx=0x7f92700090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 msgr2=0x7f928015beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f927800cc70 tx=0x7f9278001aa0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 shutdown_connections 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f925c065180 0x7f925c067630 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9280156c50 0x7f928015beb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92800adcf0 0x7f92801500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 --2- 172.21.15.146:0/2749940693 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92800abb00 0x7f92800a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 >> 172.21.15.146:0/2749940693 conn(0x7f9280067750 msgr2=0x7f92800ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 shutdown_connections 2024-08-17T02:26:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.449+0000 7f9285400640 1 -- 172.21.15.146:0/2749940693 wait complete. 2024-08-17T02:26:32.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.617+0000 7fbed1000640 1 Processor -- start 2024-08-17T02:26:32.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.617+0000 7fbed1000640 1 -- start start 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.618+0000 7fbed1000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbecc156c50 0x7fbecc0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.618+0000 7fbed1000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 0x7fbecc0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.618+0000 7fbed1000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0ab130 con 0x7fbecc0abb00 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.618+0000 7fbed1000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0ae5a0 con 0x7fbecc156c50 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.618+0000 7fbed1000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0ae2c0 con 0x7fbecc0adcf0 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbeca800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbecc0abb00 0x7fbecc0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39260/0 (socket says 172.21.15.146:39260) 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbeca800640 1 -- 172.21.15.146:0/3332628920 learned_addr learned my addr 172.21.15.146:0/3332628920 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec9400640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 0x7fbecc0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec9e00640 1 --2- 172.21.15.146:0/3332628920 >> v2:172.21.15.150:3300/0 conn(0x7fbecc156c50 0x7fbecc0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec8a00640 1 -- 172.21.15.146:0/3332628920 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062590997 0 0) 0x7fbecc0ab130 con 0x7fbecc0abb00 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec8a00640 1 -- 172.21.15.146:0/3332628920 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb00034e0 con 0x7fbecc0abb00 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec9e00640 1 -- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 msgr2=0x7fbecc0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec9e00640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 0x7fbecc0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.619+0000 7fbec9e00640 1 -- 172.21.15.146:0/3332628920 >> v1:172.21.15.146:6789/0 conn(0x7fbecc0abb00 legacy=0x7fbecc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.620+0000 7fbec9e00640 1 -- 172.21.15.146:0/3332628920 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0aaae0 con 0x7fbecc156c50 2024-08-17T02:26:32.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.620+0000 7fbec9400640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 0x7fbecc0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbec9e00640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc156c50 0x7fbecc0c7cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009850 tx=0x7fbebc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb4e0a29b3e2048 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbec8a00640 1 -- 172.21.15.146:0/3332628920 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc02ad00 con 0x7fbecc156c50 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbec8a00640 1 -- 172.21.15.146:0/3332628920 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc02ae60 con 0x7fbecc156c50 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbec8a00640 1 -- 172.21.15.146:0/3332628920 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc032650 con 0x7fbecc156c50 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 -- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc156c50 msgr2=0x7fbecc0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc156c50 0x7fbecc0c7cf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009850 tx=0x7fbebc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 -- 172.21.15.146:0/3332628920 shutdown_connections 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0adcf0 0x7fbecc0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 --2- 172.21.15.146:0/3332628920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc156c50 0x7fbecc0c7cf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.621+0000 7fbed1000640 1 -- 172.21.15.146:0/3332628920 >> 172.21.15.146:0/3332628920 conn(0x7fbecc067750 msgr2=0x7fbecc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.622+0000 7fbed1000640 1 -- 172.21.15.146:0/3332628920 shutdown_connections 2024-08-17T02:26:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.622+0000 7fbed1000640 1 -- 172.21.15.146:0/3332628920 wait complete. 2024-08-17T02:26:32.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.623+0000 7fbed1000640 1 Processor -- start 2024-08-17T02:26:32.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.623+0000 7fbed1000640 1 -- start start 2024-08-17T02:26:32.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0abb00 0x7fbecc142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc0adcf0 0x7fbecc0c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc159220 con 0x7fbecc156c50 2024-08-17T02:26:32.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1434f0 con 0x7fbecc0adcf0 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbed1000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc158610 con 0x7fbecc0abb00 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbeca800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbeca800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48486/0 (socket says 172.21.15.146:48486) 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbeca800640 1 -- 172.21.15.146:0/2833505203 learned_addr learned my addr 172.21.15.146:0/2833505203 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbec9e00640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0abb00 0x7fbecc142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.624+0000 7fbec9400640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc0adcf0 0x7fbecc0c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 -- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0abb00 msgr2=0x7fbecc142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0abb00 0x7fbecc142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 -- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc0adcf0 msgr2=0x7fbecc0c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc0adcf0 0x7fbecc0c0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 -- 172.21.15.146:0/2833505203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8009390 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbeca800640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbec400cc70 tx=0x7fbec4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400ce90 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400a850 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc009390 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400ac10 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.625+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc158bd0 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.626+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc1593d0 con 0x7fbecc156c50 2024-08-17T02:26:32.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.627+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbec4007300 con 0x7fbecc156c50 2024-08-17T02:26:32.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.628+0000 7fbec1600640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 0x7fbeac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.628+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbec40824e0 con 0x7fbecc156c50 2024-08-17T02:26:32.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.628+0000 7fbec9e00640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 0x7fbeac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.629+0000 7fbec9e00640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 0x7fbeac067630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbebc034000 tx=0x7fbebc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.632+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbecc1593d0 con 0x7fbecc156c50 2024-08-17T02:26:32.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.807+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbecc1593d0 con 0x7fbecc156c50 2024-08-17T02:26:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.807+0000 7fbec1600640 1 -- 172.21.15.146:0/2833505203 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbecc1593d0 con 0x7fbecc156c50 2024-08-17T02:26:32.809 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.809+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 msgr2=0x7fbeac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.809+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 0x7fbeac067630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbebc034000 tx=0x7fbebc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.809+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 msgr2=0x7fbecc0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.809+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbec400cc70 tx=0x7fbec4001aa0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 shutdown_connections 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbeac065180 0x7fbeac067630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbecc156c50 0x7fbecc0a98e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc0adcf0 0x7fbecc0c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 --2- 172.21.15.146:0/2833505203 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0abb00 0x7fbecc142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 >> 172.21.15.146:0/2833505203 conn(0x7fbecc067750 msgr2=0x7fbecc0ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 shutdown_connections 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.810+0000 7fbed1000640 1 -- 172.21.15.146:0/2833505203 wait complete. 2024-08-17T02:26:32.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.975+0000 7ff793200640 1 Processor -- start 2024-08-17T02:26:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.975+0000 7ff793200640 1 -- start start 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff793200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7940cc010 0x7ff7940ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff793200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940ab950 con 0x7ff7940a98e0 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff793200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940abc30 con 0x7ff79415c7c0 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff793200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940abf10 con 0x7ff7940cc010 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff791e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7940cc010 0x7ff7940ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff789400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff7940a98e0 0x7ff7940afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39264/0 (socket says 172.21.15.146:39264) 2024-08-17T02:26:32.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff789400640 1 -- 172.21.15.146:0/1581172361 learned_addr learned my addr 172.21.15.146:0/1581172361 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff791e00640 1 -- 172.21.15.146:0/1581172361 >> v1:172.21.15.150:6789/0 conn(0x7ff79415c7c0 legacy=0x7ff794066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff791e00640 1 -- 172.21.15.146:0/1581172361 >> v1:172.21.15.146:6789/0 conn(0x7ff7940a98e0 legacy=0x7ff7940afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff791e00640 1 -- 172.21.15.146:0/1581172361 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940af970 con 0x7ff7940cc010 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.977+0000 7ff791400640 1 -- 172.21.15.146:0/1581172361 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424947982 0 0) 0x7ff7940ab950 con 0x7ff7940a98e0 2024-08-17T02:26:32.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.978+0000 7ff791e00640 1 --2- 172.21.15.146:0/1581172361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7940cc010 0x7ff7940ab2b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff784009850 tx=0x7ff7840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03832fd925a2de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff791400640 1 -- 172.21.15.146:0/1581172361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78402ad00 con 0x7ff7940cc010 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff791400640 1 -- 172.21.15.146:0/1581172361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78402ae60 con 0x7ff7940cc010 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff791400640 1 -- 172.21.15.146:0/1581172361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784032670 con 0x7ff7940cc010 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 -- 172.21.15.146:0/1581172361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7940cc010 msgr2=0x7ff7940ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 --2- 172.21.15.146:0/1581172361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7940cc010 0x7ff7940ab2b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff784009850 tx=0x7ff7840090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 -- 172.21.15.146:0/1581172361 shutdown_connections 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 --2- 172.21.15.146:0/1581172361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7940cc010 0x7ff7940ab2b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 -- 172.21.15.146:0/1581172361 >> 172.21.15.146:0/1581172361 conn(0x7ff794067de0 msgr2=0x7ff7940681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 -- 172.21.15.146:0/1581172361 shutdown_connections 2024-08-17T02:26:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.979+0000 7ff793200640 1 -- 172.21.15.146:0/1581172361 wait complete. 2024-08-17T02:26:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 Processor -- start 2024-08-17T02:26:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 -- start start 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 0x7ff79415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7940cc010 0x7ff79415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7941552b0 con 0x7ff79415c7c0 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940cbd80 con 0x7ff7940a98e0 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.981+0000 7ff793200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79415adc0 con 0x7ff7940cc010 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48500/0 (socket says 172.21.15.146:48500) 2024-08-17T02:26:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 -- 172.21.15.146:0/3652465713 learned_addr learned my addr 172.21.15.146:0/3652465713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff791e00640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 0x7ff79415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff789400640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7940cc010 0x7ff79415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 -- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7940cc010 msgr2=0x7ff79415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7940cc010 0x7ff79415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 -- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 msgr2=0x7ff79415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 0x7ff79415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 -- 172.21.15.146:0/3652465713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009390 con 0x7ff79415c7c0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff791e00640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 0x7ff79415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.982+0000 7ff792800640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00b8e0 tx=0x7ff78c009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.983+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00c8c0 con 0x7ff79415c7c0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.983+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00c040 con 0x7ff79415c7c0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.983+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79415b0a0 con 0x7ff79415c7c0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.983+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00ccb0 con 0x7ff79415c7c0 2024-08-17T02:26:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.983+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79416a6c0 con 0x7ff79415c7c0 2024-08-17T02:26:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.984+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff794071050 con 0x7ff79415c7c0 2024-08-17T02:26:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.985+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff78c014620 con 0x7ff79415c7c0 2024-08-17T02:26:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.985+0000 7ff78a000640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 0x7ff770067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.986+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff78c081eb0 con 0x7ff79415c7c0 2024-08-17T02:26:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.986+0000 7ff791e00640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 0x7ff770067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.986+0000 7ff791e00640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 0x7ff770067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff784034000 tx=0x7ff784032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:32.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:32.990+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff78c04ce40 con 0x7ff79415c7c0 2024-08-17T02:26:33.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.164+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7940b1620 con 0x7ff79415c7c0 2024-08-17T02:26:33.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.165+0000 7ff78a000640 1 -- 172.21.15.146:0/3652465713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff78c053960 con 0x7ff79415c7c0 2024-08-17T02:26:33.166 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:33.166 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 msgr2=0x7ff770067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 0x7ff770067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff784034000 tx=0x7ff784032000 comp rx=0 tx=0).stop 2024-08-17T02:26:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 msgr2=0x7ff7941692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00b8e0 tx=0x7ff78c009400 comp rx=0 tx=0).stop 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 shutdown_connections 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff770065150 0x7ff770067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79415c7c0 0x7ff7941692d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7940cc010 0x7ff79415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 --2- 172.21.15.146:0/3652465713 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7940a98e0 0x7ff79415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 >> 172.21.15.146:0/3652465713 conn(0x7ff794067de0 msgr2=0x7ff7940aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 shutdown_connections 2024-08-17T02:26:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.167+0000 7ff793200640 1 -- 172.21.15.146:0/3652465713 wait complete. 2024-08-17T02:26:33.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:33.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.334+0000 7fc589200640 1 Processor -- start 2024-08-17T02:26:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.334+0000 7fc589200640 1 -- start start 2024-08-17T02:26:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.335+0000 7fc589200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc5840ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.335+0000 7fc589200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc5840ce5c0 0x7fc5840b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.335+0000 7fc589200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840ceeb0 con 0x7fc584158e50 2024-08-17T02:26:33.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.335+0000 7fc589200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840cf190 con 0x7fc5840ce5c0 2024-08-17T02:26:33.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.335+0000 7fc589200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840cf470 con 0x7fc5840cc8d0 2024-08-17T02:26:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc583400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc584158e50 0x7fc5840cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39268/0 (socket says 172.21.15.146:39268) 2024-08-17T02:26:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc583400640 1 -- 172.21.15.146:0/2790101948 learned_addr learned my addr 172.21.15.146:0/2790101948 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc57aa00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc5840ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc583e00640 1 --2- 172.21.15.146:0/2790101948 >> v2:172.21.15.150:3300/0 conn(0x7fc5840ce5c0 0x7fc5840b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59886676 0 0) 0x7fc5840ceeb0 con 0x7fc584158e50 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5680034e0 con 0x7fc584158e50 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3664280613 0 0) 0x7fc5680034e0 con 0x7fc584158e50 2024-08-17T02:26:33.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 msgr2=0x7fc5840ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc5840ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 >> v2:172.21.15.150:3300/0 conn(0x7fc5840ce5c0 msgr2=0x7fc5840b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 --2- 172.21.15.146:0/2790101948 >> v2:172.21.15.150:3300/0 conn(0x7fc5840ce5c0 0x7fc5840b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840b2a00 con 0x7fc584158e50 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7fc574001470 con 0x7fc584158e50 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 >> v1:172.21.15.146:6789/0 conn(0x7fc584158e50 legacy=0x7fc5840cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc568003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.336+0000 7fc582a00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc568004020 0x7fc568004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc582a00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc568004cc0 0x7fc568005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840cf190 con 0x7fc568004cc0 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840cf470 con 0x7fc568004020 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56800bad0 con 0x7fc5840cc8d0 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc568004cc0 0x7fc568005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583400640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc568003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc57aa00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc568004020 0x7fc568004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 -- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 msgr2=0x7fc568003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5840cc8d0 0x7fc568003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 -- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc568004020 msgr2=0x7fc568004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc568004020 0x7fc568004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.337+0000 7fc583e00640 1 -- 172.21.15.146:0/2790101948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680034e0 con 0x7fc568004cc0 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.338+0000 7fc583e00640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc568004cc0 0x7fc568005130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0094d0 tx=0x7fc57c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc5eed9ba741c60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.338+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c02c040 con 0x7fc568004cc0 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.338+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00f040 con 0x7fc568004cc0 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.338+0000 7fc582a00640 1 -- 172.21.15.146:0/2790101948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c030630 con 0x7fc568004cc0 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 -- 172.21.15.146:0/2790101948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc568004cc0 msgr2=0x7fc568005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 --2- 172.21.15.146:0/2790101948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc568004cc0 0x7fc568005130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0094d0 tx=0x7fc57c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc583e00640 1 -- 172.21.15.146:0/2790101948 reap_dead start 2024-08-17T02:26:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 -- 172.21.15.146:0/2790101948 shutdown_connections 2024-08-17T02:26:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 -- 172.21.15.146:0/2790101948 >> 172.21.15.146:0/2790101948 conn(0x7fc584098de0 msgr2=0x7fc58406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 -- 172.21.15.146:0/2790101948 shutdown_connections 2024-08-17T02:26:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.339+0000 7fc589200640 1 -- 172.21.15.146:0/2790101948 wait complete. 2024-08-17T02:26:33.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.340+0000 7fc589200640 1 Processor -- start 2024-08-17T02:26:33.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.341+0000 7fc589200640 1 -- start start 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.341+0000 7fc589200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 0x7fc5841581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.341+0000 7fc589200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.341+0000 7fc589200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc584099750 0x7fc584099ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc589200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415a820 con 0x7fc584159d80 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc589200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415ab00 con 0x7fc584099750 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc589200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415ade0 con 0x7fc568004cc0 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48516/0 (socket says 172.21.15.146:48516) 2024-08-17T02:26:33.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 -- 172.21.15.146:0/89013232 learned_addr learned my addr 172.21.15.146:0/89013232 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc583400640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 0x7fc5841581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc583e00640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc584099750 0x7fc584099ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 -- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 msgr2=0x7fc5841581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 0x7fc5841581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 -- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc584099750 msgr2=0x7fc584099ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc584099750 0x7fc584099ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 -- 172.21.15.146:0/89013232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58415b0c0 con 0x7fc584159d80 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc583400640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 0x7fc5841581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.342+0000 7fc57aa00640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011a60 tx=0x7fc56c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.343+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00fb00 con 0x7fc584159d80 2024-08-17T02:26:33.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.343+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c00fc60 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.343+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58415b3a0 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.343+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c014440 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.343+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58409b8f0 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.344+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc584068e20 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.345+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc56c014870 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.345+0000 7fc57b400640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 0x7fc560067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.346+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc56c018030 con 0x7fc584159d80 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.346+0000 7fc583400640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 0x7fc560067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.346+0000 7fc583400640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 0x7fc560067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc574001050 tx=0x7fc574009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.350+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc584068e20 con 0x7fc584159d80 2024-08-17T02:26:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.522+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc584068e20 con 0x7fc584159d80 2024-08-17T02:26:33.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.522+0000 7fc57b400640 1 -- 172.21.15.146:0/89013232 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc584068e20 con 0x7fc584159d80 2024-08-17T02:26:33.524 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 msgr2=0x7fc560067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 0x7fc560067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc574001050 tx=0x7fc574009040 comp rx=0 tx=0).stop 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 msgr2=0x7fc58415a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011a60 tx=0x7fc56c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 shutdown_connections 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc560065150 0x7fc560067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc584159d80 0x7fc58415a1d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc584099750 0x7fc584099ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 --2- 172.21.15.146:0/89013232 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc568004cc0 0x7fc5841581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.524+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 >> 172.21.15.146:0/89013232 conn(0x7fc584098de0 msgr2=0x7fc5840b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.525+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 shutdown_connections 2024-08-17T02:26:33.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.525+0000 7fc589200640 1 -- 172.21.15.146:0/89013232 wait complete. 2024-08-17T02:26:33.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:33.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.691+0000 7f55a2200640 1 Processor -- start 2024-08-17T02:26:33.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.691+0000 7f55a2200640 1 -- start start 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.692+0000 7f55a2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.692+0000 7f55a2200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f559c0c8bd0 0x7f559c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.692+0000 7f55a2200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0ab130 con 0x7f559c0adcf0 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.692+0000 7f55a2200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0c9530 con 0x7f559c156c50 2024-08-17T02:26:33.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.692+0000 7f55a2200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0ae5a0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48526/0 (socket says 172.21.15.146:48526) 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 -- 172.21.15.146:0/2247727948 learned_addr learned my addr 172.21.15.146:0/2247727948 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559be00640 1 --2- 172.21.15.146:0/2247727948 >> v2:172.21.15.150:3300/0 conn(0x7f559c0c8bd0 0x7f559c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 -- 172.21.15.146:0/2247727948 >> v2:172.21.15.150:3300/0 conn(0x7f559c0c8bd0 msgr2=0x7f559c0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 --2- 172.21.15.146:0/2247727948 >> v2:172.21.15.150:3300/0 conn(0x7f559c0c8bd0 0x7f559c0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 -- 172.21.15.146:0/2247727948 >> v1:172.21.15.150:6789/0 conn(0x7f559c0adcf0 legacy=0x7f559c0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.693+0000 7f559b400640 1 -- 172.21.15.146:0/2247727948 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0ae2c0 con 0x7f559c156c50 2024-08-17T02:26:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.694+0000 7f559b400640 1 --2- 172.21.15.146:0/2247727948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c0c7cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f559c070660 tx=0x7f558c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5412f86c829cb1b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f559a000640 1 -- 172.21.15.146:0/2247727948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c031400 con 0x7f559c156c50 2024-08-17T02:26:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f559a000640 1 -- 172.21.15.146:0/2247727948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c02d050 con 0x7f559c156c50 2024-08-17T02:26:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f559a000640 1 -- 172.21.15.146:0/2247727948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0317d0 con 0x7f559c156c50 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 -- 172.21.15.146:0/2247727948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 msgr2=0x7f559c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 --2- 172.21.15.146:0/2247727948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c0c7cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f559c070660 tx=0x7f558c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 -- 172.21.15.146:0/2247727948 shutdown_connections 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 --2- 172.21.15.146:0/2247727948 >> v2:172.21.15.150:3300/0 conn(0x7f559c0c8bd0 0x7f559c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 --2- 172.21.15.146:0/2247727948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 -- 172.21.15.146:0/2247727948 >> 172.21.15.146:0/2247727948 conn(0x7f559c067750 msgr2=0x7f559c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 -- 172.21.15.146:0/2247727948 shutdown_connections 2024-08-17T02:26:33.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.695+0000 7f55a2200640 1 -- 172.21.15.146:0/2247727948 wait complete. 2024-08-17T02:26:33.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.697+0000 7f55a2200640 1 Processor -- start 2024-08-17T02:26:33.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.697+0000 7f55a2200640 1 -- start start 2024-08-17T02:26:33.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c156c50 0x7f559c0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c155240 con 0x7f559c0c8bd0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1549a0 con 0x7f559c156c50 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f55a2200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c154c80 con 0x7f559c0adcf0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f559aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f559aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48542/0 (socket says 172.21.15.146:48542) 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f559aa00640 1 -- 172.21.15.146:0/45614839 learned_addr learned my addr 172.21.15.146:0/45614839 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f559b400640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.698+0000 7f559be00640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c156c50 0x7f559c0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 -- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 msgr2=0x7f559c149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 -- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c156c50 msgr2=0x7f559c0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c156c50 0x7f559c0aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 -- 172.21.15.146:0/45614839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c009ae0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f559aa00640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f558800c560 tx=0x7f5588007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588011590 con 0x7f559c0c8bd0 2024-08-17T02:26:33.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880116f0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588011af0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c154f60 con 0x7f559c0c8bd0 2024-08-17T02:26:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.699+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c155550 con 0x7f559c0c8bd0 2024-08-17T02:26:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.700+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c071050 con 0x7f559c0c8bd0 2024-08-17T02:26:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.701+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f558801b3b0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.702+0000 7f5592a00640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 0x7f557c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:33.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.702+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55880818d0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.702+0000 7f559b400640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 0x7f557c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:33.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.703+0000 7f559b400640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 0x7f557c067630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f558c033000 tx=0x7f558c036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:33.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.706+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f558804f9a0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.879+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f559c153870 con 0x7f559c0c8bd0 2024-08-17T02:26:33.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.879+0000 7f5592a00640 1 -- 172.21.15.146:0/45614839 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55880170a0 con 0x7f559c0c8bd0 2024-08-17T02:26:33.880 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 msgr2=0x7f557c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 0x7f557c067630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f558c033000 tx=0x7f558c036000 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 msgr2=0x7f559c153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f558800c560 tx=0x7f5588007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 shutdown_connections 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f557c065180 0x7f557c067630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c0c8bd0 0x7f559c153f50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c156c50 0x7f559c0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 --2- 172.21.15.146:0/45614839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:33.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.881+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 >> 172.21.15.146:0/45614839 conn(0x7f559c067750 msgr2=0x7f559c14b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:33.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.882+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 shutdown_connections 2024-08-17T02:26:33.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:33.882+0000 7f55a2200640 1 -- 172.21.15.146:0/45614839 wait complete. 2024-08-17T02:26:33.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.049+0000 7f0959800640 1 Processor -- start 2024-08-17T02:26:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.049+0000 7f0959800640 1 -- start start 2024-08-17T02:26:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0959800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0954155a80 0x7f095406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0959800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09540c7db0 0x7f09540c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0959800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09541598f0 con 0x7f0954155e50 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0959800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0954159bd0 con 0x7f09540c7db0 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0959800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0954159eb0 con 0x7f0954155a80 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f094a000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09540c7db0 0x7f09540c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0953400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0954155e50 0x7f095406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39276/0 (socket says 172.21.15.146:39276) 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0953400640 1 -- 172.21.15.146:0/2605028267 learned_addr learned my addr 172.21.15.146:0/2605028267 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.050+0000 7f0952a00640 1 --2- 172.21.15.146:0/2605028267 >> v2:172.21.15.150:3300/0 conn(0x7f0954155a80 0x7f095406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.051+0000 7f094a000640 1 -- 172.21.15.146:0/2605028267 >> v2:172.21.15.150:3300/0 conn(0x7f0954155a80 msgr2=0x7f095406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.051+0000 7f094a000640 1 --2- 172.21.15.146:0/2605028267 >> v2:172.21.15.150:3300/0 conn(0x7f0954155a80 0x7f095406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.051+0000 7f094a000640 1 -- 172.21.15.146:0/2605028267 >> v1:172.21.15.146:6789/0 conn(0x7f0954155e50 legacy=0x7f095406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.051+0000 7f094a000640 1 -- 172.21.15.146:0/2605028267 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095415a190 con 0x7f09540c7db0 2024-08-17T02:26:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.051+0000 7f0952000640 1 -- 172.21.15.146:0/2605028267 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592951919 0 0) 0x7f09541598f0 con 0x7f0954155e50 2024-08-17T02:26:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.052+0000 7f094a000640 1 --2- 172.21.15.146:0/2605028267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09540c7db0 0x7f09540c8bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f095406efd0 tx=0x7f093c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c6d0d1ea548a16 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.052+0000 7f0952000640 1 -- 172.21.15.146:0/2605028267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c02ae40 con 0x7f09540c7db0 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.052+0000 7f0952000640 1 -- 172.21.15.146:0/2605028267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c032440 con 0x7f09540c7db0 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.052+0000 7f0952000640 1 -- 172.21.15.146:0/2605028267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0327e0 con 0x7f09540c7db0 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 -- 172.21.15.146:0/2605028267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09540c7db0 msgr2=0x7f09540c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 --2- 172.21.15.146:0/2605028267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09540c7db0 0x7f09540c8bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f095406efd0 tx=0x7f093c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 -- 172.21.15.146:0/2605028267 shutdown_connections 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 --2- 172.21.15.146:0/2605028267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09540c7db0 0x7f09540c8bd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 --2- 172.21.15.146:0/2605028267 >> v2:172.21.15.150:3300/0 conn(0x7f0954155a80 0x7f095406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 -- 172.21.15.146:0/2605028267 >> 172.21.15.146:0/2605028267 conn(0x7f0954067750 msgr2=0x7f09540c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 -- 172.21.15.146:0/2605028267 shutdown_connections 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.053+0000 7f0959800640 1 -- 172.21.15.146:0/2605028267 wait complete. 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.054+0000 7f0959800640 1 Processor -- start 2024-08-17T02:26:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.054+0000 7f0959800640 1 -- start start 2024-08-17T02:26:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09540c7db0 0x7f0954158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0954155e50 0x7f09541562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954165900 con 0x7f0954155a80 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954165be0 con 0x7f0954155e50 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0959800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0954165ec0 con 0x7f09540c7db0 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f094a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f094a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48562/0 (socket says 172.21.15.146:48562) 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f094a000640 1 -- 172.21.15.146:0/982797665 learned_addr learned my addr 172.21.15.146:0/982797665 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0953400640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0954155e50 0x7f09541562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.055+0000 7f0952a00640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09540c7db0 0x7f0954158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 -- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09540c7db0 msgr2=0x7f0954158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09540c7db0 0x7f0954158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 -- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0954155e50 msgr2=0x7f09541562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0954155e50 0x7f09541562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 -- 172.21.15.146:0/982797665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009390 con 0x7f0954155a80 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094a000640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f093c009880 tx=0x7f093c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c000d10 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c031a60 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09541661a0 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.056+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c031e60 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.057+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09540aff30 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.058+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954071050 con 0x7f0954155a80 2024-08-17T02:26:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.058+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f093c03c400 con 0x7f0954155a80 2024-08-17T02:26:34.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.059+0000 7f094aa00640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 0x7f0930067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.059+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f093c02ae40 con 0x7f0954155a80 2024-08-17T02:26:34.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.059+0000 7f0952a00640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 0x7f0930067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.060+0000 7f0952a00640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 0x7f0930067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f095415a0d0 tx=0x7f09440090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.063+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f093c070ab0 con 0x7f0954155a80 2024-08-17T02:26:34.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.235+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09540b0510 con 0x7f0954155a80 2024-08-17T02:26:34.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.236+0000 7f094aa00640 1 -- 172.21.15.146:0/982797665 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f093c0740d0 con 0x7f0954155a80 2024-08-17T02:26:34.237 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:34.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 msgr2=0x7f0930067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 0x7f0930067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f095415a0d0 tx=0x7f09440090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 msgr2=0x7f09540af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f093c009880 tx=0x7f093c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 shutdown_connections 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0930065150 0x7f0930067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0954155a80 0x7f09540af9f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0954155e50 0x7f09541562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 --2- 172.21.15.146:0/982797665 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09540c7db0 0x7f0954158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 >> 172.21.15.146:0/982797665 conn(0x7f0954067750 msgr2=0x7f09540aab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 shutdown_connections 2024-08-17T02:26:34.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.238+0000 7f0959800640 1 -- 172.21.15.146:0/982797665 wait complete. 2024-08-17T02:26:34.331 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:26:34.331 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:26:34.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.480+0000 7f1273000640 1 Processor -- start 2024-08-17T02:26:34.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.480+0000 7f1273000640 1 -- start start 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1273000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f126c158bd0 0x7f126c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1273000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f126c0ac710 0x7f126c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1273000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0aec20 con 0x7f126c069540 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1273000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0699c0 con 0x7f126c158bd0 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1273000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0acb10 con 0x7f126c0ac710 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1271c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f126c158bd0 0x7f126c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1271200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f126c069540 0x7f126c0ac000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39292/0 (socket says 172.21.15.146:39292) 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.481+0000 7f1271200640 1 -- 172.21.15.146:0/3645790357 learned_addr learned my addr 172.21.15.146:0/3645790357 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:34.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f1272600640 1 --2- 172.21.15.146:0/3645790357 >> v2:172.21.15.150:3300/0 conn(0x7f126c0ac710 0x7f126c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f1271c00640 1 -- 172.21.15.146:0/3645790357 >> v2:172.21.15.150:3300/0 conn(0x7f126c0ac710 msgr2=0x7f126c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f1271c00640 1 --2- 172.21.15.146:0/3645790357 >> v2:172.21.15.150:3300/0 conn(0x7f126c0ac710 0x7f126c0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f1271c00640 1 -- 172.21.15.146:0/3645790357 >> v1:172.21.15.146:6789/0 conn(0x7f126c069540 legacy=0x7f126c0ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f1271c00640 1 -- 172.21.15.146:0/3645790357 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0ae330 con 0x7f126c158bd0 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.482+0000 7f126be00640 1 -- 172.21.15.146:0/3645790357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126352260 0 0) 0x7f126c0aec20 con 0x7f126c069540 2024-08-17T02:26:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.483+0000 7f1271c00640 1 --2- 172.21.15.146:0/3645790357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c069000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f126c0aeb90 tx=0x7f12600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661f76641eaf15e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.483+0000 7f126be00640 1 -- 172.21.15.146:0/3645790357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126002ad00 con 0x7f126c158bd0 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.483+0000 7f126be00640 1 -- 172.21.15.146:0/3645790357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126002ae60 con 0x7f126c158bd0 2024-08-17T02:26:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.483+0000 7f126be00640 1 -- 172.21.15.146:0/3645790357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260032670 con 0x7f126c158bd0 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 -- 172.21.15.146:0/3645790357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 msgr2=0x7f126c069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 --2- 172.21.15.146:0/3645790357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c069000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f126c0aeb90 tx=0x7f12600090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 -- 172.21.15.146:0/3645790357 shutdown_connections 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 --2- 172.21.15.146:0/3645790357 >> v2:172.21.15.150:3300/0 conn(0x7f126c0ac710 0x7f126c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 --2- 172.21.15.146:0/3645790357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c069000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 -- 172.21.15.146:0/3645790357 >> 172.21.15.146:0/3645790357 conn(0x7f126c096a70 msgr2=0x7f126c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 -- 172.21.15.146:0/3645790357 shutdown_connections 2024-08-17T02:26:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.484+0000 7f1273000640 1 -- 172.21.15.146:0/3645790357 wait complete. 2024-08-17T02:26:34.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.485+0000 7f1273000640 1 Processor -- start 2024-08-17T02:26:34.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.485+0000 7f1273000640 1 -- start start 2024-08-17T02:26:34.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 0x7f126c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f126c0ac710 0x7f126c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c098b30 con 0x7f126c158bd0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c153c60 con 0x7f126c0ac710 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.486+0000 7f1273000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0caed0 con 0x7f126c069540 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48586/0 (socket says 172.21.15.146:48586) 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 -- 172.21.15.146:0/1767160601 learned_addr learned my addr 172.21.15.146:0/1767160601 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1271200640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f126c0ac710 0x7f126c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1271c00640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 0x7f126c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 -- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 msgr2=0x7f126c153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 0x7f126c153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 -- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f126c0ac710 msgr2=0x7f126c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f126c0ac710 0x7f126c0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 -- 172.21.15.146:0/1767160601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009390 con 0x7f126c158bd0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1271c00640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 0x7f126c153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1272600640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1264009fa0 tx=0x7f1264009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.487+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400ee60 con 0x7f126c158bd0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.488+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264014420 con 0x7f126c158bd0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.488+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640147e0 con 0x7f126c158bd0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.488+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c098200 con 0x7f126c158bd0 2024-08-17T02:26:34.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.488+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0987c0 con 0x7f126c158bd0 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.489+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c071050 con 0x7f126c158bd0 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.490+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1264014b50 con 0x7f126c158bd0 2024-08-17T02:26:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.490+0000 7f1268c00640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 0x7f124c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.490+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1264082c90 con 0x7f126c158bd0 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.491+0000 7f1271c00640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 0x7f124c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.491+0000 7f1271c00640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 0x7f124c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1260034000 tx=0x7f1260032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.494+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1264050cb0 con 0x7f126c158bd0 2024-08-17T02:26:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.667+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f126c098c70 con 0x7f126c158bd0 2024-08-17T02:26:34.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.668+0000 7f1268c00640 1 -- 172.21.15.146:0/1767160601 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f12640542d0 con 0x7f126c158bd0 2024-08-17T02:26:34.669 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:34.670 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 msgr2=0x7f124c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 0x7f124c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1260034000 tx=0x7f1260032000 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 msgr2=0x7f126c0aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1264009fa0 tx=0x7f1264009900 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 shutdown_connections 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f124c065150 0x7f124c067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c158bd0 0x7f126c0aa5e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f126c0ac710 0x7f126c0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 --2- 172.21.15.146:0/1767160601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f126c069540 0x7f126c153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.670+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 >> 172.21.15.146:0/1767160601 conn(0x7f126c096a70 msgr2=0x7f126c06a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.671+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 shutdown_connections 2024-08-17T02:26:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.671+0000 7f1273000640 1 -- 172.21.15.146:0/1767160601 wait complete. 2024-08-17T02:26:34.687 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:34.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.840+0000 7fe7b4a00640 1 Processor -- start 2024-08-17T02:26:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.841+0000 7fe7b4a00640 1 -- start start 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7b4a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7b006df00 0x7fe7b006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7b4a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b015a0e0 0x7fe7b00aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7b4a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00af5f0 con 0x7fe7b00aae40 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7b4a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b0159600 con 0x7fe7b006df00 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7b4a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01598e0 con 0x7fe7b015a0e0 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7b006df00 0x7fe7b006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7b006df00 0x7fe7b006e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39120/0 (socket says 172.21.15.146:39120) 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 -- 172.21.15.146:0/4236682661 learned_addr learned my addr 172.21.15.146:0/4236682661 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7a6a00640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b015a0e0 0x7fe7b00aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 -- 172.21.15.146:0/4236682661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b015a0e0 msgr2=0x7fe7b00aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b015a0e0 0x7fe7b00aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 -- 172.21.15.146:0/4236682661 >> v1:172.21.15.150:6789/0 conn(0x7fe7b00aae40 legacy=0x7fe7b00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.842+0000 7fe7af400640 1 -- 172.21.15.146:0/4236682661 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0159bc0 con 0x7fe7b006df00 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.843+0000 7fe7af400640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b006df00 0x7fe7b006e2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009f20 tx=0x7fe7a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd38277a6e71e831 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7aea00640 1 -- 172.21.15.146:0/4236682661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0031400 con 0x7fe7b006df00 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7aea00640 1 -- 172.21.15.146:0/4236682661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a002d050 con 0x7fe7b006df00 2024-08-17T02:26:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7aea00640 1 -- 172.21.15.146:0/4236682661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00317d0 con 0x7fe7b006df00 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 -- 172.21.15.146:0/4236682661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b006df00 msgr2=0x7fe7b006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b006df00 0x7fe7b006e2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009f20 tx=0x7fe7a0009840 comp rx=0 tx=0).stop 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 -- 172.21.15.146:0/4236682661 shutdown_connections 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b015a0e0 0x7fe7b00aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/4236682661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b006df00 0x7fe7b006e2d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 -- 172.21.15.146:0/4236682661 >> 172.21.15.146:0/4236682661 conn(0x7fe7b0067750 msgr2=0x7fe7b006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 -- 172.21.15.146:0/4236682661 shutdown_connections 2024-08-17T02:26:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.844+0000 7fe7b4a00640 1 -- 172.21.15.146:0/4236682661 wait complete. 2024-08-17T02:26:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.846+0000 7fe7b4a00640 1 Processor -- start 2024-08-17T02:26:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.846+0000 7fe7b4a00640 1 -- start start 2024-08-17T02:26:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b006df00 0x7fe7b01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b00aae40 0x7fe7b00afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c15e0 con 0x7fe7b015a0e0 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c18c0 con 0x7fe7b006df00 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7b4a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c1ba0 con 0x7fe7b00aae40 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39128/0 (socket says 172.21.15.146:39128) 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7afe00640 1 -- 172.21.15.146:0/499436485 learned_addr learned my addr 172.21.15.146:0/499436485 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7af400640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b006df00 0x7fe7b01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.847+0000 7fe7a6a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b00aae40 0x7fe7b00afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 -- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b00aae40 msgr2=0x7fe7b00afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b00aae40 0x7fe7b00afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 -- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b006df00 msgr2=0x7fe7b01522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b006df00 0x7fe7b01522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 -- 172.21.15.146:0/499436485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009ae0 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7afe00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c5e0 tx=0x7fe7a8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8012630 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8012790 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b00c1e80 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8012bd0 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.848+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b0158bc0 con 0x7fe7b015a0e0 2024-08-17T02:26:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.849+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0071050 con 0x7fe7b015a0e0 2024-08-17T02:26:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.850+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe7a801b400 con 0x7fe7b015a0e0 2024-08-17T02:26:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.851+0000 7fe7a7400640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 0x7fe78c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.851+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7a8082460 con 0x7fe7b015a0e0 2024-08-17T02:26:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.852+0000 7fe7af400640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 0x7fe78c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.852+0000 7fe7af400640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 0x7fe78c067630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0033000 tx=0x7fe7a0036000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:34.855+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe7a8050530 con 0x7fe7b015a0e0 2024-08-17T02:26:35.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.030+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7b00aa550 con 0x7fe7b015a0e0 2024-08-17T02:26:35.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.030+0000 7fe7a7400640 1 -- 172.21.15.146:0/499436485 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7a8016020 con 0x7fe7b015a0e0 2024-08-17T02:26:35.033 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.032+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 msgr2=0x7fe78c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.032+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 0x7fe78c067630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0033000 tx=0x7fe7a0036000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.032+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 msgr2=0x7fe7b00b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.032+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c5e0 tx=0x7fe7a8007ed0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 shutdown_connections 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe78c065180 0x7fe78c067630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b015a0e0 0x7fe7b00b03f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe7b00aae40 0x7fe7b00afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 --2- 172.21.15.146:0/499436485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7b006df00 0x7fe7b01522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 >> 172.21.15.146:0/499436485 conn(0x7fe7b0067750 msgr2=0x7fe7b00adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 shutdown_connections 2024-08-17T02:26:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.033+0000 7fe7b4a00640 1 -- 172.21.15.146:0/499436485 wait complete. 2024-08-17T02:26:35.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.200+0000 7f1693200640 1 Processor -- start 2024-08-17T02:26:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.200+0000 7f1693200640 1 -- start start 2024-08-17T02:26:35.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.201+0000 7f1693200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c156c50 0x7f168c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.201+0000 7f1693200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f168c0adcf0 0x7f168c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.201+0000 7f1693200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0ab130 con 0x7f168c0abb00 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1693200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0ae5a0 con 0x7f168c0adcf0 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1693200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0ae2c0 con 0x7f168c156c50 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1691200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f168c0abb00 0x7f168c0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46380/0 (socket says 172.21.15.146:46380) 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1683400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f168c0adcf0 0x7f168c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1691200640 1 -- 172.21.15.146:0/2297897808 learned_addr learned my addr 172.21.15.146:0/2297897808 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f168be00640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c156c50 0x7f168c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1683400640 1 -- 172.21.15.146:0/2297897808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c156c50 msgr2=0x7f168c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1683400640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c156c50 0x7f168c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1683400640 1 -- 172.21.15.146:0/2297897808 >> v1:172.21.15.146:6789/0 conn(0x7f168c0abb00 legacy=0x7f168c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f1683400640 1 -- 172.21.15.146:0/2297897808 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0aaae0 con 0x7f168c0adcf0 2024-08-17T02:26:35.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.202+0000 7f168b400640 1 -- 172.21.15.146:0/2297897808 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281356228 0 0) 0x7f168c0ab130 con 0x7f168c0abb00 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.203+0000 7f1683400640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0adcf0 0x7f168c0ab5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1674009850 tx=0x7f16740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6695a14a38f0e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.203+0000 7f168b400640 1 -- 172.21.15.146:0/2297897808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167402ad00 con 0x7f168c0adcf0 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f168b400640 1 -- 172.21.15.146:0/2297897808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167402ae60 con 0x7f168c0adcf0 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f168b400640 1 -- 172.21.15.146:0/2297897808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674032670 con 0x7f168c0adcf0 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 -- 172.21.15.146:0/2297897808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0adcf0 msgr2=0x7f168c0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0adcf0 0x7f168c0ab5c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1674009850 tx=0x7f16740090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 -- 172.21.15.146:0/2297897808 shutdown_connections 2024-08-17T02:26:35.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c0adcf0 0x7f168c0ab5c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 --2- 172.21.15.146:0/2297897808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c156c50 0x7f168c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 -- 172.21.15.146:0/2297897808 >> 172.21.15.146:0/2297897808 conn(0x7f168c067750 msgr2=0x7f168c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 -- 172.21.15.146:0/2297897808 shutdown_connections 2024-08-17T02:26:35.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.204+0000 7f1693200640 1 -- 172.21.15.146:0/2297897808 wait complete. 2024-08-17T02:26:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.206+0000 7f1693200640 1 Processor -- start 2024-08-17T02:26:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.206+0000 7f1693200640 1 -- start start 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.206+0000 7f1693200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c0abb00 0x7f168c148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.206+0000 7f1693200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f168c0adcf0 0x7f168c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1693200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1693200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c14c3f0 con 0x7f168c156c50 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1693200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c14a160 con 0x7f168c0adcf0 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1693200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c157410 con 0x7f168c0abb00 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39138/0 (socket says 172.21.15.146:39138) 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 -- 172.21.15.146:0/683511058 learned_addr learned my addr 172.21.15.146:0/683511058 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f168be00640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c0abb00 0x7f168c148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1683400640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f168c0adcf0 0x7f168c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 -- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c0abb00 msgr2=0x7f168c148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c0abb00 0x7f168c148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 -- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f168c0adcf0 msgr2=0x7f168c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f168c0adcf0 0x7f168c159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.207+0000 7f1691200640 1 -- 172.21.15.146:0/683511058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674009390 con 0x7f168c156c50 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1691200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f168400ccc0 tx=0x7f16840019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400ce80 con 0x7f168c156c50 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400a850 con 0x7f168c156c50 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c1576f0 con 0x7f168c156c50 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400ac10 con 0x7f168c156c50 2024-08-17T02:26:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.208+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c159f90 con 0x7f168c156c50 2024-08-17T02:26:35.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.209+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c14c560 con 0x7f168c156c50 2024-08-17T02:26:35.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.210+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1684007300 con 0x7f168c156c50 2024-08-17T02:26:35.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.210+0000 7f1683e00640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 0x7f1668067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.211+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1684082690 con 0x7f168c156c50 2024-08-17T02:26:35.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.211+0000 7f168be00640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 0x7f1668067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.211+0000 7f168be00640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 0x7f1668067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f167c00bb70 tx=0x7f167c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.215+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f16840506a0 con 0x7f168c156c50 2024-08-17T02:26:35.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.389+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f168c071050 con 0x7f168c156c50 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.390+0000 7f1683e00640 1 -- 172.21.15.146:0/683511058 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f168400b0d0 con 0x7f168c156c50 2024-08-17T02:26:35.391 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 msgr2=0x7f1668067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 0x7f1668067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f167c00bb70 tx=0x7f167c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 msgr2=0x7f168c14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f168400ccc0 tx=0x7f16840019e0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 shutdown_connections 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1668065150 0x7f1668067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f168c156c50 0x7f168c14c880 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f168c0adcf0 0x7f168c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 --2- 172.21.15.146:0/683511058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f168c0abb00 0x7f168c148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 >> 172.21.15.146:0/683511058 conn(0x7f168c067750 msgr2=0x7f168c0ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 shutdown_connections 2024-08-17T02:26:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.392+0000 7f1693200640 1 -- 172.21.15.146:0/683511058 wait complete. 2024-08-17T02:26:35.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.560+0000 7fa85d200640 1 Processor -- start 2024-08-17T02:26:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.560+0000 7fa85d200640 1 -- start start 2024-08-17T02:26:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa85d200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa858156c60 0x7fa8580aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa85d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa858096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa85d200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580ad650 con 0x7fa858096fb0 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa85d200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa858097430 con 0x7fa858156c60 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa85d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580ae490 con 0x7fa8580aade0 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa856800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa858096fb0 0x7fa8580ae920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46384/0 (socket says 172.21.15.146:46384) 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.561+0000 7fa856800640 1 -- 172.21.15.146:0/1039775887 learned_addr learned my addr 172.21.15.146:0/1039775887 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa84fe00640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa858096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855e00640 1 --2- 172.21.15.146:0/1039775887 >> v2:172.21.15.150:3300/0 conn(0x7fa858156c60 0x7fa8580aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855400640 1 -- 172.21.15.146:0/1039775887 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461414446 0 0) 0x7fa8580ad650 con 0x7fa858096fb0 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855400640 1 -- 172.21.15.146:0/1039775887 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa83c0034e0 con 0x7fa858096fb0 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855e00640 1 -- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 msgr2=0x7fa858096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855e00640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa858096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855e00640 1 -- 172.21.15.146:0/1039775887 >> v1:172.21.15.146:6789/0 conn(0x7fa858096fb0 legacy=0x7fa8580ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa855e00640 1 -- 172.21.15.146:0/1039775887 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580ad880 con 0x7fa858156c60 2024-08-17T02:26:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.562+0000 7fa84fe00640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa858096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.563+0000 7fa855e00640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa8580aa8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa848009850 tx=0x7fa8480090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891861fd1b33224d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa855400640 1 -- 172.21.15.146:0/1039775887 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84802ad90 con 0x7fa858156c60 2024-08-17T02:26:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa855400640 1 -- 172.21.15.146:0/1039775887 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848032440 con 0x7fa858156c60 2024-08-17T02:26:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa855400640 1 -- 172.21.15.146:0/1039775887 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848032820 con 0x7fa858156c60 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 -- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 msgr2=0x7fa8580aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa8580aa8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa848009850 tx=0x7fa8480090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 -- 172.21.15.146:0/1039775887 shutdown_connections 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa858096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 --2- 172.21.15.146:0/1039775887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa8580aa8a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.564+0000 7fa85d200640 1 -- 172.21.15.146:0/1039775887 >> 172.21.15.146:0/1039775887 conn(0x7fa8580b2fd0 msgr2=0x7fa8580b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.565+0000 7fa85d200640 1 -- 172.21.15.146:0/1039775887 shutdown_connections 2024-08-17T02:26:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.565+0000 7fa85d200640 1 -- 172.21.15.146:0/1039775887 wait complete. 2024-08-17T02:26:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.566+0000 7fa85d200640 1 Processor -- start 2024-08-17T02:26:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.566+0000 7fa85d200640 1 -- start start 2024-08-17T02:26:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa85806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa85806be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85815a020 con 0x7fa858096fb0 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581503d0 con 0x7fa858156c60 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa85d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa858159d40 con 0x7fa8580aade0 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa855e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa855e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39152/0 (socket says 172.21.15.146:39152) 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa855e00640 1 -- 172.21.15.146:0/3820896029 learned_addr learned my addr 172.21.15.146:0/3820896029 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.567+0000 7fa84fe00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa85806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa856800640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa85806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 -- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 msgr2=0x7fa85806b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa85806b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 -- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 msgr2=0x7fa85806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa85806be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 -- 172.21.15.146:0/3820896029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840009390 con 0x7fa858096fb0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa84fe00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa85806b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa855e00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa848009850 tx=0x7fa848032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848031900 con 0x7fa858096fb0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848031a60 con 0x7fa858096fb0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848031e20 con 0x7fa858096fb0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa848009390 con 0x7fa858096fb0 2024-08-17T02:26:35.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.568+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa858150060 con 0x7fa858096fb0 2024-08-17T02:26:35.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.569+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85814fbe0 con 0x7fa858096fb0 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.570+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa848043030 con 0x7fa858096fb0 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.571+0000 7fa84d600640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 0x7fa8340676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.571+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa848041070 con 0x7fa858096fb0 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.571+0000 7fa84fe00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 0x7fa8340676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.572+0000 7fa84fe00640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 0x7fa8340676b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa840009360 tx=0x7fa840008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.575+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa85814fbe0 con 0x7fa858096fb0 2024-08-17T02:26:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.750+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa85814fbe0 con 0x7fa858096fb0 2024-08-17T02:26:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.750+0000 7fa84d600640 1 -- 172.21.15.146:0/3820896029 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa85814fbe0 con 0x7fa858096fb0 2024-08-17T02:26:35.752 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 msgr2=0x7fa8340676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 0x7fa8340676b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa840009360 tx=0x7fa840008040 comp rx=0 tx=0).stop 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 msgr2=0x7fa8581486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa848009850 tx=0x7fa848032000 comp rx=0 tx=0).stop 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 shutdown_connections 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa834065200 0x7fa8340676b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa858156c60 0x7fa85806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8580aade0 0x7fa85806b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 --2- 172.21.15.146:0/3820896029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa858096fb0 0x7fa8581486b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.752+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 >> 172.21.15.146:0/3820896029 conn(0x7fa8580b2fd0 msgr2=0x7fa858152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.753+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 shutdown_connections 2024-08-17T02:26:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.753+0000 7fa85d200640 1 -- 172.21.15.146:0/3820896029 wait complete. 2024-08-17T02:26:35.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:26:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.918+0000 7f7eada00640 1 Processor -- start 2024-08-17T02:26:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.918+0000 7f7eada00640 1 -- start start 2024-08-17T02:26:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7eada00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7eada00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea80ab950 con 0x7f7ea80a98e0 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7eada00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea80abc30 con 0x7f7ea815c7c0 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7eada00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80abf10 con 0x7f7ea80cc010 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7ea7400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7ea80a98e0 0x7f7ea80afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46394/0 (socket says 172.21.15.146:46394) 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.919+0000 7f7ea7400640 1 -- 172.21.15.146:0/3239105717 learned_addr learned my addr 172.21.15.146:0/3239105717 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea7e00640 1 --2- 172.21.15.146:0/3239105717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566425089 0 0) 0x7f7ea80ab950 con 0x7f7ea80a98e0 2024-08-17T02:26:35.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8c0034e0 con 0x7f7ea80a98e0 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828075380 0 0) 0x7f7ea80abc30 con 0x7f7ea815c7c0 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea80ab950 con 0x7f7ea815c7c0 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea7e00640 1 -- 172.21.15.146:0/3239105717 >> v1:172.21.15.150:6789/0 conn(0x7f7ea815c7c0 legacy=0x7f7ea8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea7e00640 1 -- 172.21.15.146:0/3239105717 >> v1:172.21.15.146:6789/0 conn(0x7f7ea80a98e0 legacy=0x7f7ea80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.920+0000 7f7ea7e00640 1 -- 172.21.15.146:0/3239105717 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80af970 con 0x7f7ea80cc010 2024-08-17T02:26:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.921+0000 7f7ea7e00640 1 --2- 172.21.15.146:0/3239105717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea80ab2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009880 tx=0x7f7e980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79729ed8c2a045f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9802ad80 con 0x7f7ea80cc010 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e98032440 con 0x7f7ea80cc010 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7ea6a00640 1 -- 172.21.15.146:0/3239105717 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980327c0 con 0x7f7ea80cc010 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 -- 172.21.15.146:0/3239105717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 msgr2=0x7f7ea80ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 --2- 172.21.15.146:0/3239105717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea80ab2b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009880 tx=0x7f7e980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 -- 172.21.15.146:0/3239105717 shutdown_connections 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 --2- 172.21.15.146:0/3239105717 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea80ab2b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 -- 172.21.15.146:0/3239105717 >> 172.21.15.146:0/3239105717 conn(0x7f7ea8067de0 msgr2=0x7f7ea80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 -- 172.21.15.146:0/3239105717 shutdown_connections 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.922+0000 7f7eada00640 1 -- 172.21.15.146:0/3239105717 wait complete. 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.924+0000 7f7eada00640 1 Processor -- start 2024-08-17T02:26:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.924+0000 7f7eada00640 1 -- start start 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 0x7f7ea815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8152230 con 0x7f7ea80a98e0 2024-08-17T02:26:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8159ef0 con 0x7f7ea815c7c0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7eada00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8159320 con 0x7f7ea80cc010 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39154/0 (socket says 172.21.15.146:39154) 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 -- 172.21.15.146:0/1301161570 learned_addr learned my addr 172.21.15.146:0/1301161570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ead000640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 0x7f7ea815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7400640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 -- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 msgr2=0x7f7ea815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 -- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 msgr2=0x7f7ea815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 0x7f7ea815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ea7e00640 1 -- 172.21.15.146:0/1301161570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009390 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.925+0000 7f7ead000640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 0x7f7ea815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7ea7e00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e980098e0 tx=0x7f7e98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98031880 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e980319e0 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98031d80 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea81595c0 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.926+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea81518b0 con 0x7f7ea80a98e0 2024-08-17T02:26:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.927+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8071050 con 0x7f7ea80a98e0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.928+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e9803c400 con 0x7f7ea80a98e0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.929+0000 7f7e9f400640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 0x7f7e88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.929+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e980a28e0 con 0x7f7ea80a98e0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.929+0000 7f7ea7400640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 0x7f7e88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.930+0000 7f7ea7400640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 0x7f7e88067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80aeb10 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:35.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:35.933+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e98070900 con 0x7f7ea80a98e0 2024-08-17T02:26:36.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.169+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f7ea80b1620 con 0x7f7ea80a98e0 2024-08-17T02:26:36.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.816+0000 7f7e9f400640 1 -- 172.21.15.146:0/1301161570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7e980430d0 con 0x7f7ea80a98e0 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 msgr2=0x7f7e88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 0x7f7e88067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80aeb10 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 msgr2=0x7f7ea8151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e980098e0 tx=0x7f7e98032000 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 shutdown_connections 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7e88065150 0x7f7e88067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ea815c7c0 0x7f7ea815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ea80cc010 0x7f7ea815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 --2- 172.21.15.146:0/1301161570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ea80a98e0 0x7f7ea8151370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.818+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 >> 172.21.15.146:0/1301161570 conn(0x7f7ea8067de0 msgr2=0x7f7ea806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.819+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 shutdown_connections 2024-08-17T02:26:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.819+0000 7f7eada00640 1 -- 172.21.15.146:0/1301161570 wait complete. 2024-08-17T02:26:36.835 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.988+0000 7f7cc9c00640 1 Processor -- start 2024-08-17T02:26:36.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.988+0000 7f7cc9c00640 1 -- start start 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc9c00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7cc40adcf0 0x7f7cc40ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc9c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7cc40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc9c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40ab130 con 0x7f7cc4156c50 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc9c00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40ae5a0 con 0x7f7cc40adcf0 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc9c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40ae2c0 con 0x7f7cc40abb00 2024-08-17T02:26:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7cc4156c50 0x7f7cc40c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46398/0 (socket says 172.21.15.146:46398) 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.989+0000 7f7cc2a00640 1 -- 172.21.15.146:0/1725178211 learned_addr learned my addr 172.21.15.146:0/1725178211 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546872446 0 0) 0x7f7cc40ab130 con 0x7f7cc4156c50 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca80034e0 con 0x7f7cc4156c50 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc2000640 1 --2- 172.21.15.146:0/1725178211 >> v2:172.21.15.150:3300/0 conn(0x7f7cc40adcf0 0x7f7cc40ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc3400640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7cc40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120894237 0 0) 0x7f7ca80034e0 con 0x7f7cc4156c50 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 msgr2=0x7f7cc40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7cc40c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 >> v2:172.21.15.150:3300/0 conn(0x7f7cc40adcf0 msgr2=0x7f7cc40ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 --2- 172.21.15.146:0/1725178211 >> v2:172.21.15.150:3300/0 conn(0x7f7cc40adcf0 0x7f7cc40ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc40aaae0 con 0x7f7cc4156c50 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f7cb4001470 con 0x7f7cc4156c50 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 >> v1:172.21.15.146:6789/0 conn(0x7f7cc4156c50 legacy=0x7f7cc40c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ca80039d0 0x7f7ca8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7ca8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca8004cc0 0x7f7ca8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40ae5a0 con 0x7f7ca80039d0 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40ae2c0 con 0x7f7ca8004cc0 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca800bb90 con 0x7f7cc40abb00 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.990+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ca80039d0 0x7f7ca8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2000640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7ca8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc3400640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca8004cc0 0x7f7ca8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2a00640 1 -- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 msgr2=0x7f7ca8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7ca8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2a00640 1 -- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca8004cc0 msgr2=0x7f7ca8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca8004cc0 0x7f7ca8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2a00640 1 -- 172.21.15.146:0/1725178211 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80034e0 con 0x7f7ca80039d0 2024-08-17T02:26:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.991+0000 7f7cc2000640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc40abb00 0x7f7ca8004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.992+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ca80039d0 0x7f7ca8003de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c2a0 tx=0x7f7cb4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38807e01959fee30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.992+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4005890 con 0x7f7ca80039d0 2024-08-17T02:26:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.992+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4005a30 con 0x7f7ca80039d0 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.992+0000 7f7cc1600640 1 -- 172.21.15.146:0/1725178211 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4005e30 con 0x7f7ca80039d0 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 -- 172.21.15.146:0/1725178211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ca80039d0 msgr2=0x7f7ca8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/1725178211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ca80039d0 0x7f7ca8003de0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c2a0 tx=0x7f7cb4001e90 comp rx=0 tx=0).stop 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc3400640 1 -- 172.21.15.146:0/1725178211 reap_dead start 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 -- 172.21.15.146:0/1725178211 shutdown_connections 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 -- 172.21.15.146:0/1725178211 >> 172.21.15.146:0/1725178211 conn(0x7f7cc4067750 msgr2=0x7f7cc40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 -- 172.21.15.146:0/1725178211 shutdown_connections 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.993+0000 7f7cc9c00640 1 -- 172.21.15.146:0/1725178211 wait complete. 2024-08-17T02:26:36.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.994+0000 7f7cc9c00640 1 Processor -- start 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.994+0000 7f7cc9c00640 1 -- start start 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 0x7f7cc40c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc41465f0 0x7f7cc4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4157b80 con 0x7f7cc4146180 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4157250 con 0x7f7ca80039d0 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc9c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4157530 con 0x7f7cc41465f0 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39184/0 (socket says 172.21.15.146:39184) 2024-08-17T02:26:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.995+0000 7f7cc2000640 1 -- 172.21.15.146:0/3077073676 learned_addr learned my addr 172.21.15.146:0/3077073676 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc3400640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc41465f0 0x7f7cc4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 0x7f7cc40c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 -- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc41465f0 msgr2=0x7f7cc4154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc41465f0 0x7f7cc4154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 -- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 msgr2=0x7f7cc40c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 0x7f7cc40c0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 -- 172.21.15.146:0/3077073676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4157810 con 0x7f7cc4146180 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 0x7f7cc40c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc2000640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0010d30 tx=0x7f7cb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0010e90 con 0x7f7cc4146180 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000ee50 con 0x7f7cc4146180 2024-08-17T02:26:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc40c0fd0 con 0x7f7cc4146180 2024-08-17T02:26:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.996+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0014660 con 0x7f7cc4146180 2024-08-17T02:26:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.997+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4154d70 con 0x7f7cc4146180 2024-08-17T02:26:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.998+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc4157cf0 con 0x7f7cc4146180 2024-08-17T02:26:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.998+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7cb0014a10 con 0x7f7cc4146180 2024-08-17T02:26:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.999+0000 7f7cba000640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 0x7f7ca4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:36.999+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7cb0082ee0 con 0x7f7cc4146180 2024-08-17T02:26:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.000+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 0x7f7ca4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.000+0000 7f7cc2a00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 0x7f7ca4067630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4033000 tx=0x7f7cb4034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.003+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7cb0050fb0 con 0x7f7cc4146180 2024-08-17T02:26:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.177+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7cc41579a0 con 0x7f7cc4146180 2024-08-17T02:26:37.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.182+0000 7f7cba000640 1 -- 172.21.15.146:0/3077073676 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7cb00545d0 con 0x7f7cc4146180 2024-08-17T02:26:37.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 msgr2=0x7f7ca4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 0x7f7ca4067630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4033000 tx=0x7f7cb4034000 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 msgr2=0x7f7cc41540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0010d30 tx=0x7f7cb0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 shutdown_connections 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ca4065180 0x7f7ca4067630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cc4146180 0x7f7cc41540d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc41465f0 0x7f7cc4154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 --2- 172.21.15.146:0/3077073676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ca80039d0 0x7f7cc40c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 >> 172.21.15.146:0/3077073676 conn(0x7f7cc4067750 msgr2=0x7f7cc40a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 shutdown_connections 2024-08-17T02:26:37.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:37.184+0000 7f7cc9c00640 1 -- 172.21.15.146:0/3077073676 wait complete. 2024-08-17T02:26:37.202 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:26:37.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:37.285 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:26:37.374 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:26:37.374 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:26:37.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:37.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:26:37.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:26:37.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:37.436 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:26:37.486 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:26:37.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:37.486 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:26:37.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:26:37.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:37.553 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:26:37.851 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:26:37.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:37.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:26:37.913 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:26:37.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:37.914 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:26:37.949 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:26:37.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:26:37.950 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:26:38.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:38.013 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:26:38.050 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:26:38.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.199+0000 7f9595a00640 1 Processor -- start 2024-08-17T02:26:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.199+0000 7f9595a00640 1 -- start start 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f9595a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95900aa8f0 0x7f959006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f9595a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f959015c600 0x7f9590066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f9595a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959006b9d0 con 0x7f959015c230 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f9595a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959006ebf0 con 0x7f959015c600 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f9595a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900aad80 con 0x7f95900aa8f0 2024-08-17T02:26:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f958ea00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f959015c230 0x7f959006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46408/0 (socket says 172.21.15.146:46408) 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.200+0000 7f958ea00640 1 -- 172.21.15.146:0/234178212 learned_addr learned my addr 172.21.15.146:0/234178212 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958f400640 1 --2- 172.21.15.146:0/234178212 >> v2:172.21.15.146:3300/0 conn(0x7f959015c600 0x7f9590066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f9586000640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95900aa8f0 0x7f959006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958e000640 1 -- 172.21.15.146:0/234178212 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342275833 0 0) 0x7f959006b9d0 con 0x7f959015c230 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958e000640 1 -- 172.21.15.146:0/234178212 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95740034e0 con 0x7f959015c230 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958f400640 1 -- 172.21.15.146:0/234178212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95900aa8f0 msgr2=0x7f959006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958f400640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95900aa8f0 0x7f959006be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958f400640 1 -- 172.21.15.146:0/234178212 >> v1:172.21.15.146:6789/0 conn(0x7f959015c230 legacy=0x7f959006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.201+0000 7f958f400640 1 -- 172.21.15.146:0/234178212 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900ab060 con 0x7f959015c600 2024-08-17T02:26:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.202+0000 7f958f400640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c600 0x7f9590066cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9588009e60 tx=0x7f9588009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d0ca3247d4ac3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.202+0000 7f958e000640 1 -- 172.21.15.146:0/234178212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588007550 con 0x7f959015c600 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.202+0000 7f958e000640 1 -- 172.21.15.146:0/234178212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958802d050 con 0x7f959015c600 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.202+0000 7f958e000640 1 -- 172.21.15.146:0/234178212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588007920 con 0x7f959015c600 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 -- 172.21.15.146:0/234178212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c600 msgr2=0x7f9590066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c600 0x7f9590066cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9588009e60 tx=0x7f9588009780 comp rx=0 tx=0).stop 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 -- 172.21.15.146:0/234178212 shutdown_connections 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c600 0x7f9590066cd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 --2- 172.21.15.146:0/234178212 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f95900aa8f0 0x7f959006be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 -- 172.21.15.146:0/234178212 >> 172.21.15.146:0/234178212 conn(0x7f959006d8f0 msgr2=0x7f959006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 -- 172.21.15.146:0/234178212 shutdown_connections 2024-08-17T02:26:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.203+0000 7f9595a00640 1 -- 172.21.15.146:0/234178212 wait complete. 2024-08-17T02:26:38.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.204+0000 7f9595a00640 1 Processor -- start 2024-08-17T02:26:38.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.204+0000 7f9595a00640 1 -- start start 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 0x7f95900cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 0x7f95900c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900cbcb0 con 0x7f959015c230 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900ca6d0 con 0x7f95900aa8f0 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9595a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900ca9b0 con 0x7f959015c600 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.205+0000 7f9586000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39210/0 (socket says 172.21.15.146:39210) 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 -- 172.21.15.146:0/3283220969 learned_addr learned my addr 172.21.15.146:0/3283220969 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 -- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 msgr2=0x7f95900c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f958f400640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 0x7f95900c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 0x7f95900c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 -- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 msgr2=0x7f95900cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f958ea00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 0x7f95900cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 0x7f95900cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 -- 172.21.15.146:0/3283220969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588009a20 con 0x7f959015c230 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f958f400640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 0x7f95900c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f958ea00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 0x7f95900cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586000640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f957800ea20 tx=0x7f95780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800ca10 con 0x7f959015c230 2024-08-17T02:26:38.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800cb70 con 0x7f959015c230 2024-08-17T02:26:38.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578013470 con 0x7f959015c230 2024-08-17T02:26:38.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.206+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95900cac90 con 0x7f959015c230 2024-08-17T02:26:38.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.207+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95900cb250 con 0x7f959015c230 2024-08-17T02:26:38.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.208+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9590064db0 con 0x7f959015c230 2024-08-17T02:26:38.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.208+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9578013860 con 0x7f959015c230 2024-08-17T02:26:38.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.209+0000 7f9586a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 0x7f956c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.209+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9578082940 con 0x7f959015c230 2024-08-17T02:26:38.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.209+0000 7f958ea00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 0x7f956c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.210+0000 7f958ea00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 0x7f956c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.214+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9578050a20 con 0x7f959015c230 2024-08-17T02:26:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.425+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f959015ae50 con 0x7f959015c230 2024-08-17T02:26:38.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.426+0000 7f9586a00640 1 -- 172.21.15.146:0/3283220969 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f9578054040 con 0x7f959015c230 2024-08-17T02:26:38.427 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:38.427 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:38.427 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 msgr2=0x7f956c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 0x7f956c067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580009040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 msgr2=0x7f95900c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f957800ea20 tx=0x7f95780090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 shutdown_connections 2024-08-17T02:26:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f956c065150 0x7f956c067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959015c230 0x7f95900c5130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f959015c600 0x7f95900c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 --2- 172.21.15.146:0/3283220969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95900aa8f0 0x7f95900cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 >> 172.21.15.146:0/3283220969 conn(0x7f959006d8f0 msgr2=0x7f95900b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 shutdown_connections 2024-08-17T02:26:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.428+0000 7f9595a00640 1 -- 172.21.15.146:0/3283220969 wait complete. 2024-08-17T02:26:38.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.593+0000 7f51eac00640 1 Processor -- start 2024-08-17T02:26:38.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.593+0000 7f51eac00640 1 -- start start 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.594+0000 7f51eac00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f51e406e790 0x7f51e40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.594+0000 7f51eac00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40afc10 con 0x7f51e4155180 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.594+0000 7f51eac00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40af000 con 0x7f51e4155550 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.594+0000 7f51eac00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40af2e0 con 0x7f51e406e790 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.594+0000 7f51e3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51e4155180 0x7f51e40ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46410/0 (socket says 172.21.15.146:46410) 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e3e00640 1 -- 172.21.15.146:0/4243937625 learned_addr learned my addr 172.21.15.146:0/4243937625 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e8c00640 1 --2- 172.21.15.146:0/4243937625 >> v2:172.21.15.150:3300/0 conn(0x7f51e406e790 0x7f51e40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660988544 0 0) 0x7f51e40af000 con 0x7f51e4155550 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c80034e0 con 0x7f51e4155550 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449452373 0 0) 0x7f51e40afc10 con 0x7f51e4155180 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e40af000 con 0x7f51e4155180 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e8c00640 1 -- 172.21.15.146:0/4243937625 >> v1:172.21.15.150:6789/0 conn(0x7f51e4155550 legacy=0x7f51e406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e8c00640 1 -- 172.21.15.146:0/4243937625 >> v1:172.21.15.146:6789/0 conn(0x7f51e4155180 legacy=0x7f51e40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.595+0000 7f51e8c00640 1 -- 172.21.15.146:0/4243937625 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40af5c0 con 0x7f51e406e790 2024-08-17T02:26:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.596+0000 7f51e8c00640 1 --2- 172.21.15.146:0/4243937625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e406e790 0x7f51e40aea20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00af70 tx=0x7f51dc00a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4e5ff467c4ab99 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.596+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00a2e0 con 0x7f51e406e790 2024-08-17T02:26:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc008450 con 0x7f51e406e790 2024-08-17T02:26:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51e2a00640 1 -- 172.21.15.146:0/4243937625 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0087f0 con 0x7f51e406e790 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 -- 172.21.15.146:0/4243937625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e406e790 msgr2=0x7f51e40aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 --2- 172.21.15.146:0/4243937625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e406e790 0x7f51e40aea20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00af70 tx=0x7f51dc00a890 comp rx=0 tx=0).stop 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 -- 172.21.15.146:0/4243937625 shutdown_connections 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 --2- 172.21.15.146:0/4243937625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e406e790 0x7f51e40aea20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 -- 172.21.15.146:0/4243937625 >> 172.21.15.146:0/4243937625 conn(0x7f51e40cb9b0 msgr2=0x7f51e40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 -- 172.21.15.146:0/4243937625 shutdown_connections 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.597+0000 7f51eac00640 1 -- 172.21.15.146:0/4243937625 wait complete. 2024-08-17T02:26:38.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.598+0000 7f51eac00640 1 Processor -- start 2024-08-17T02:26:38.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 -- start start 2024-08-17T02:26:38.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e406e790 0x7f51e40a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e4155550 0x7f51e40692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4140f90 con 0x7f51e4155180 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e414f670 con 0x7f51e4155550 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.599+0000 7f51eac00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4141740 con 0x7f51e406e790 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39212/0 (socket says 172.21.15.146:39212) 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 -- 172.21.15.146:0/192723002 learned_addr learned my addr 172.21.15.146:0/192723002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3e00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e406e790 0x7f51e40a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e8c00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e4155550 0x7f51e40692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 -- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e406e790 msgr2=0x7f51e40a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e406e790 0x7f51e40a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 -- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e4155550 msgr2=0x7f51e40692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e4155550 0x7f51e40692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 -- 172.21.15.146:0/192723002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc00ab30 con 0x7f51e4155180 2024-08-17T02:26:38.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.600+0000 7f51e3400640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c4e0 tx=0x7f51d0007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.601+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0011590 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.601+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0011710 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.601+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0011ad0 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.601+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4141a20 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.601+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4141fe0 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.602+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e4064db0 con 0x7f51e4155180 2024-08-17T02:26:38.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.603+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f51d0012420 con 0x7f51e4155180 2024-08-17T02:26:38.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.603+0000 7f51db400640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 0x7f51c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.603+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51d0081f50 con 0x7f51e4155180 2024-08-17T02:26:38.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.604+0000 7f51e3e00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 0x7f51c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.604+0000 7f51e3e00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 0x7f51c4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51d4007fd0 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.607+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51d0050020 con 0x7f51e4155180 2024-08-17T02:26:38.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.780+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51e406e570 con 0x7f51e4155180 2024-08-17T02:26:38.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.781+0000 7f51db400640 1 -- 172.21.15.146:0/192723002 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f51d0053640 con 0x7f51e4155180 2024-08-17T02:26:38.782 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:38.782 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:38.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 msgr2=0x7f51c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 0x7f51c4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f51d4007fd0 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:38.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 msgr2=0x7f51e4068d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c4e0 tx=0x7f51d0007da0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 shutdown_connections 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f51c4065150 0x7f51c4067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e4155180 0x7f51e4068d70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51e4155550 0x7f51e40692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 --2- 172.21.15.146:0/192723002 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51e406e790 0x7f51e40a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 >> 172.21.15.146:0/192723002 conn(0x7f51e40cb9b0 msgr2=0x7f51e4153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 shutdown_connections 2024-08-17T02:26:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.783+0000 7f51eac00640 1 -- 172.21.15.146:0/192723002 wait complete. 2024-08-17T02:26:38.800 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:01.321612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:02.063578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:26:38.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.951+0000 7f8ceca00640 1 Processor -- start 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.952+0000 7f8ceca00640 1 -- start start 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ceca00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ce80adec0 0x7f8ce815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ceca00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce8157070 con 0x7f8ce80b0a80 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ceca00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce815b410 con 0x7f8ce8157e10 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ceca00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce8157330 con 0x7f8ce80adec0 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ce5e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ce80b0a80 0x7f8ce80ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46422/0 (socket says 172.21.15.146:46422) 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.953+0000 7f8ce5e00640 1 -- 172.21.15.146:0/3577616481 learned_addr learned my addr 172.21.15.146:0/3577616481 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce6800640 1 --2- 172.21.15.146:0/3577616481 >> v2:172.21.15.150:3300/0 conn(0x7f8ce80adec0 0x7f8ce815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691905828 0 0) 0x7f8ce8157070 con 0x7f8ce80b0a80 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc0034e0 con 0x7f8ce80b0a80 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038604573 0 0) 0x7f8ccc0034e0 con 0x7f8ce80b0a80 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 >> v2:172.21.15.150:3300/0 conn(0x7f8ce80adec0 msgr2=0x7f8ce815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 --2- 172.21.15.146:0/3577616481 >> v2:172.21.15.150:3300/0 conn(0x7f8ce80adec0 0x7f8ce815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 >> v1:172.21.15.150:6789/0 conn(0x7f8ce8157e10 legacy=0x7f8ce815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce8157610 con 0x7f8ce80b0a80 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f8cd8001470 con 0x7f8ce80b0a80 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 >> v1:172.21.15.146:6789/0 conn(0x7f8ce80b0a80 legacy=0x7f8ce80ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 0x7f8ccc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc004780 0x7f8ccc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ccc005180 0x7f8ccc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8157330 con 0x7f8ccc004780 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc00c120 con 0x7f8ccc005180 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc00c2e0 con 0x7f8ccc003a20 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.954+0000 7f8ce5400640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc004780 0x7f8ccc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 0x7f8ccc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce6800640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ccc005180 0x7f8ccc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 -- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ccc005180 msgr2=0x7f8ccc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ccc005180 0x7f8ccc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 -- 172.21.15.146:0/3577616481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc004780 msgr2=0x7f8ccc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc004780 0x7f8ccc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce5e00640 1 -- 172.21.15.146:0/3577616481 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0034e0 con 0x7f8ccc003a20 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.955+0000 7f8ce6800640 1 -- 172.21.15.146:0/3577616481 reap_dead start 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.956+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 0x7f8ccc003e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c190 tx=0x7f8cd8001d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a748e8aaaccf19 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.956+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8005890 con 0x7f8ccc003a20 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.956+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd802d070 con 0x7f8ccc003a20 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.956+0000 7f8ce4a00640 1 -- 172.21.15.146:0/3577616481 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8005a50 con 0x7f8ccc003a20 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 -- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 msgr2=0x7f8ccc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 0x7f8ccc003e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c190 tx=0x7f8cd8001d80 comp rx=0 tx=0).stop 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 -- 172.21.15.146:0/3577616481 shutdown_connections 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 --2- 172.21.15.146:0/3577616481 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ccc003a20 0x7f8ccc003e30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 -- 172.21.15.146:0/3577616481 >> 172.21.15.146:0/3577616481 conn(0x7f8ce8067750 msgr2=0x7f8ce80cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 -- 172.21.15.146:0/3577616481 shutdown_connections 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.957+0000 7f8ceca00640 1 -- 172.21.15.146:0/3577616481 wait complete. 2024-08-17T02:26:38.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.958+0000 7f8ceca00640 1 Processor -- start 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.958+0000 7f8ceca00640 1 -- start start 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 0x7f8ce814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 0x7f8ce815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce814f0a0 con 0x7f8ccc003a20 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8151bc0 con 0x7f8ce814e170 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ceca00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce814fc40 con 0x7f8ce8167dc0 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.959+0000 7f8ce5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39222/0 (socket says 172.21.15.146:39222) 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 -- 172.21.15.146:0/606951973 learned_addr learned my addr 172.21.15.146:0/606951973 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce6800640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 0x7f8ce815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5400640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 0x7f8ce814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 -- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 msgr2=0x7f8ce814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 0x7f8ce814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 -- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 msgr2=0x7f8ce815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 0x7f8ce815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 -- 172.21.15.146:0/606951973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce814eae0 con 0x7f8ccc003a20 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5400640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 0x7f8ce814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce6800640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 0x7f8ce815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.960+0000 7f8ce5e00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802abd0 tx=0x7f8cd8033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.961+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8007520 con 0x7f8ccc003a20 2024-08-17T02:26:38.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.961+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8007680 con 0x7f8ccc003a20 2024-08-17T02:26:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.961+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce814edc0 con 0x7f8ccc003a20 2024-08-17T02:26:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.961+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8032660 con 0x7f8ccc003a20 2024-08-17T02:26:38.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.961+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce814e5e0 con 0x7f8ccc003a20 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.962+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8069640 con 0x7f8ccc003a20 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.962+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8cd802f030 con 0x7f8ccc003a20 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.964+0000 7f8cdd600640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 0x7f8cc8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.964+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cd80a2ee0 con 0x7f8ccc003a20 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.964+0000 7f8ce5400640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 0x7f8cc8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:38.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.965+0000 7f8ce5400640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 0x7f8cc8067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80c82b0 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:38.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:38.968+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8ce8069640 con 0x7f8ccc003a20 2024-08-17T02:26:39.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.140+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ce8069640 con 0x7f8ccc003a20 2024-08-17T02:26:39.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.140+0000 7f8cdd600640 1 -- 172.21.15.146:0/606951973 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ce8069640 con 0x7f8ccc003a20 2024-08-17T02:26:39.142 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:39.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 msgr2=0x7f8cc8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 0x7f8cc8067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80c82b0 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 msgr2=0x7f8ce814c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802abd0 tx=0x7f8cd8033000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 shutdown_connections 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8cc8065150 0x7f8cc8067600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce814e170 0x7f8ce815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce8167dc0 0x7f8ce814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 --2- 172.21.15.146:0/606951973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc003a20 0x7f8ce814c010 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 >> 172.21.15.146:0/606951973 conn(0x7f8ce8067750 msgr2=0x7f8ce806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 shutdown_connections 2024-08-17T02:26:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.142+0000 7f8ceca00640 1 -- 172.21.15.146:0/606951973 wait complete. 2024-08-17T02:26:39.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:26:39.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.308+0000 7f490d800640 1 Processor -- start 2024-08-17T02:26:39.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.308+0000 7f490d800640 1 -- start start 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.309+0000 7f490d800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49080c3390 0x7f49080c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.309+0000 7f490d800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49080cb540 con 0x7f4908158e20 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.309+0000 7f490d800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49080cf7f0 con 0x7f49080caa20 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.309+0000 7f490d800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080caef0 con 0x7f49080c3390 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4906a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4908158e20 0x7f49080ca310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46428/0 (socket says 172.21.15.146:46428) 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4906a00640 1 -- 172.21.15.146:0/1407663250 learned_addr learned my addr 172.21.15.146:0/1407663250 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:39.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4907400640 1 --2- 172.21.15.146:0/1407663250 >> v2:172.21.15.150:3300/0 conn(0x7f49080c3390 0x7f49080c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4906000640 1 -- 172.21.15.146:0/1407663250 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826729619 0 0) 0x7f49080cb540 con 0x7f4908158e20 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4906000640 1 -- 172.21.15.146:0/1407663250 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ec0034e0 con 0x7f4908158e20 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4907400640 1 -- 172.21.15.146:0/1407663250 >> v1:172.21.15.150:6789/0 conn(0x7f49080caa20 legacy=0x7f49080c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4907400640 1 -- 172.21.15.146:0/1407663250 >> v1:172.21.15.146:6789/0 conn(0x7f4908158e20 legacy=0x7f49080ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.310+0000 7f4907400640 1 -- 172.21.15.146:0/1407663250 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080cb1d0 con 0x7f49080c3390 2024-08-17T02:26:39.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.311+0000 7f4907400640 1 --2- 172.21.15.146:0/1407663250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080c3390 0x7f49080c7520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4900009e60 tx=0x7f4900009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f588c117f45ae6ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.311+0000 7f4906000640 1 -- 172.21.15.146:0/1407663250 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900007550 con 0x7f49080c3390 2024-08-17T02:26:39.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f4906000640 1 -- 172.21.15.146:0/1407663250 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490002d050 con 0x7f49080c3390 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f4906000640 1 -- 172.21.15.146:0/1407663250 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000078c0 con 0x7f49080c3390 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 -- 172.21.15.146:0/1407663250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080c3390 msgr2=0x7f49080c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 --2- 172.21.15.146:0/1407663250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080c3390 0x7f49080c7520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4900009e60 tx=0x7f4900009780 comp rx=0 tx=0).stop 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 -- 172.21.15.146:0/1407663250 shutdown_connections 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 --2- 172.21.15.146:0/1407663250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080c3390 0x7f49080c7520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 -- 172.21.15.146:0/1407663250 >> 172.21.15.146:0/1407663250 conn(0x7f49080cfd70 msgr2=0x7f49080d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 -- 172.21.15.146:0/1407663250 shutdown_connections 2024-08-17T02:26:39.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.312+0000 7f490d800640 1 -- 172.21.15.146:0/1407663250 wait complete. 2024-08-17T02:26:39.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.314+0000 7f490d800640 1 Processor -- start 2024-08-17T02:26:39.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.314+0000 7f490d800640 1 -- start start 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.314+0000 7f490d800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 0x7f4908155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f490d800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080caa20 0x7f49080c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f490d800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f490d800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080b41f0 con 0x7f4908158e20 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f490d800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080b44d0 con 0x7f49080caa20 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f490d800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4908156530 con 0x7f49080c3390 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39228/0 (socket says 172.21.15.146:39228) 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 -- 172.21.15.146:0/3871381066 learned_addr learned my addr 172.21.15.146:0/3871381066 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4906a00640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 0x7f4908155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f48fe000640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080caa20 0x7f49080c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 -- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 msgr2=0x7f4908155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 0x7f4908155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 -- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080caa20 msgr2=0x7f49080c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080caa20 0x7f49080c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 -- 172.21.15.146:0/3871381066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900009a20 con 0x7f4908158e20 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4906a00640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 0x7f4908155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.315+0000 7f4907400640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4900009e60 tx=0x7f4900037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.316+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900031b10 con 0x7f4908158e20 2024-08-17T02:26:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.316+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900031c70 con 0x7f4908158e20 2024-08-17T02:26:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.316+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490003d430 con 0x7f4908158e20 2024-08-17T02:26:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.316+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4908156810 con 0x7f4908158e20 2024-08-17T02:26:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.316+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4908156170 con 0x7f4908158e20 2024-08-17T02:26:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.317+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080c98e0 con 0x7f4908158e20 2024-08-17T02:26:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.318+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4900003040 con 0x7f4908158e20 2024-08-17T02:26:39.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.319+0000 7f48fea00640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.319+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49000a4260 con 0x7f4908158e20 2024-08-17T02:26:39.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.319+0000 7f4906a00640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.320+0000 7f4906a00640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005840 tx=0x7f48f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.323+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f49080c98e0 con 0x7f4908158e20 2024-08-17T02:26:39.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.494+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49080c98e0 con 0x7f4908158e20 2024-08-17T02:26:39.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.494+0000 7f48fea00640 1 -- 172.21.15.146:0/3871381066 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49080c98e0 con 0x7f4908158e20 2024-08-17T02:26:39.496 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.496+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 msgr2=0x7f48e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.496+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005840 tx=0x7f48f8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.496+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 msgr2=0x7f4908151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.496+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4900009e60 tx=0x7f4900037000 comp rx=0 tx=0).stop 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 shutdown_connections 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f48e4065150 0x7f48e4067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4908158e20 0x7f4908151200 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49080caa20 0x7f49080c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 --2- 172.21.15.146:0/3871381066 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f49080c3390 0x7f4908155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 >> 172.21.15.146:0/3871381066 conn(0x7f49080cfd70 msgr2=0x7f49080ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 shutdown_connections 2024-08-17T02:26:39.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.497+0000 7f490d800640 1 -- 172.21.15.146:0/3871381066 wait complete. 2024-08-17T02:26:39.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:26:39.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.663+0000 7f55a1a00640 1 Processor -- start 2024-08-17T02:26:39.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.663+0000 7f55a1a00640 1 -- start start 2024-08-17T02:26:39.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f55a1a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f55a1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f55a1a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0ab130 con 0x7f559c0abb00 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f55a1a00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0ae5a0 con 0x7f559c156c50 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f55a1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0ae2c0 con 0x7f559c0adcf0 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f559aa00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.664+0000 7f5592000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f559aa00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50460/0 (socket says 172.21.15.146:50460) 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f5592000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:56128/0 (socket says 172.21.15.146:56128) 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f559aa00640 1 -- 172.21.15.146:0/197309920 learned_addr learned my addr 172.21.15.146:0/197309920 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:39.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f559b400640 1 --1- 172.21.15.146:0/197309920 >> v1:172.21.15.150:6789/0 conn(0x7f559c0abb00 0x7f559c0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:51828/0 (socket says 172.21.15.146:51828) 2024-08-17T02:26:39.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f5592000640 1 -- 172.21.15.146:0/197309920 >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 msgr2=0x7f559c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:39.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f5592000640 1 --2- 172.21.15.146:0/197309920 >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f5592000640 1 -- 172.21.15.146:0/197309920 >> v1:172.21.15.150:6789/0 conn(0x7f559c0abb00 legacy=0x7f559c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.665+0000 7f5592000640 1 -- 172.21.15.146:0/197309920 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0aaae0 con 0x7f559c0adcf0 2024-08-17T02:26:39.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.666+0000 7f5592000640 1 --2- 172.21.15.146:0/197309920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5584009850 tx=0x7f55840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec0ff08864c6956 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.666+0000 7f559a000640 1 -- 172.21.15.146:0/197309920 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558402ad00 con 0x7f559c0adcf0 2024-08-17T02:26:39.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.666+0000 7f559a000640 1 -- 172.21.15.146:0/197309920 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558402ae60 con 0x7f559c0adcf0 2024-08-17T02:26:39.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.666+0000 7f559a000640 1 -- 172.21.15.146:0/197309920 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5584032670 con 0x7f559c0adcf0 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 -- 172.21.15.146:0/197309920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 msgr2=0x7f559c0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 --2- 172.21.15.146:0/197309920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5584009850 tx=0x7f55840090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 -- 172.21.15.146:0/197309920 shutdown_connections 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 --2- 172.21.15.146:0/197309920 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0adcf0 0x7f559c0ab5c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 --2- 172.21.15.146:0/197309920 >> v2:172.21.15.150:3300/0 conn(0x7f559c156c50 0x7f559c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 -- 172.21.15.146:0/197309920 >> 172.21.15.146:0/197309920 conn(0x7f559c067750 msgr2=0x7f559c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 -- 172.21.15.146:0/197309920 shutdown_connections 2024-08-17T02:26:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.667+0000 7f55a1a00640 1 -- 172.21.15.146:0/197309920 wait complete. 2024-08-17T02:26:39.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.668+0000 7f55a1a00640 1 Processor -- start 2024-08-17T02:26:39.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.668+0000 7f55a1a00640 1 -- start start 2024-08-17T02:26:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0abb00 0x7f559c147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c0adcf0 0x7f559c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1593b0 con 0x7f559c156c50 2024-08-17T02:26:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c147880 con 0x7f559c0adcf0 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.669+0000 7f55a1a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1587a0 con 0x7f559c0abb00 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39240/0 (socket says 172.21.15.146:39240) 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 -- 172.21.15.146:0/4119455409 learned_addr learned my addr 172.21.15.146:0/4119455409 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f5592000640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c0adcf0 0x7f559c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559aa00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0abb00 0x7f559c147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 -- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0abb00 msgr2=0x7f559c147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0abb00 0x7f559c147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 -- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c0adcf0 msgr2=0x7f559c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c0adcf0 0x7f559c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 -- 172.21.15.146:0/4119455409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584009390 con 0x7f559c156c50 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.670+0000 7f559b400640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f559400c4e0 tx=0x7f5594007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.671+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940072e0 con 0x7f559c156c50 2024-08-17T02:26:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.671+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5594007460 con 0x7f559c156c50 2024-08-17T02:26:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.671+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c158a80 con 0x7f559c156c50 2024-08-17T02:26:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.671+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940049f0 con 0x7f559c156c50 2024-08-17T02:26:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.671+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c159040 con 0x7f559c156c50 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.672+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c159520 con 0x7f559c156c50 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.673+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5594013400 con 0x7f559c156c50 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.673+0000 7f5592a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 0x7f5578067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.673+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5594081c50 con 0x7f559c156c50 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.674+0000 7f559aa00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 0x7f5578067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.674+0000 7f559aa00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 0x7f5578067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f558c009fd0 tx=0x7f558c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.677+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f559c159520 con 0x7f559c156c50 2024-08-17T02:26:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.849+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f559c1594f0 con 0x7f559c156c50 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.850+0000 7f5592a00640 1 -- 172.21.15.146:0/4119455409 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f559404fd20 con 0x7f559c156c50 2024-08-17T02:26:39.851 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 msgr2=0x7f5578067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 0x7f5578067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f558c009fd0 tx=0x7f558c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 msgr2=0x7f559c158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f559400c4e0 tx=0x7f5594007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 shutdown_connections 2024-08-17T02:26:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5578065150 0x7f5578067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c156c50 0x7f559c158120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f559c0adcf0 0x7f559c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 --2- 172.21.15.146:0/4119455409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f559c0abb00 0x7f559c147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 >> 172.21.15.146:0/4119455409 conn(0x7f559c067750 msgr2=0x7f559c148dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 shutdown_connections 2024-08-17T02:26:39.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:39.852+0000 7f55a1a00640 1 -- 172.21.15.146:0/4119455409 wait complete. 2024-08-17T02:26:39.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.015+0000 7f6639e00640 1 Processor -- start 2024-08-17T02:26:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.015+0000 7f6639e00640 1 -- start start 2024-08-17T02:26:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.016+0000 7f6639e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 0x7f66340adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.016+0000 7f6639e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f663406df00 0x7f66340ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.016+0000 7f6639e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634156670 con 0x7f6634155df0 2024-08-17T02:26:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.016+0000 7f6639e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340b0350 con 0x7f663406df00 2024-08-17T02:26:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.016+0000 7f6639e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663406e5e0 con 0x7f6634155a20 2024-08-17T02:26:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f663406df00 0x7f66340ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6632a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 0x7f66340adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f663406df00 0x7f66340ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:50472/0 (socket says 172.21.15.146:50472) 2024-08-17T02:26:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 -- 172.21.15.146:0/4098152947 learned_addr learned my addr 172.21.15.146:0/4098152947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 -- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 msgr2=0x7f66340adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 0x7f66340adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 -- 172.21.15.146:0/4098152947 >> v1:172.21.15.150:6789/0 conn(0x7f6634155df0 legacy=0x7f663406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6633400640 1 -- 172.21.15.146:0/4098152947 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663406e8c0 con 0x7f663406df00 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.017+0000 7f6632a00640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 0x7f66340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.018+0000 7f6633400640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f66340ad9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f662c009f20 tx=0x7f662c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2414a5197e746e2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6631600640 1 -- 172.21.15.146:0/4098152947 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c031400 con 0x7f663406df00 2024-08-17T02:26:40.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6631600640 1 -- 172.21.15.146:0/4098152947 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c02d050 con 0x7f663406df00 2024-08-17T02:26:40.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6631600640 1 -- 172.21.15.146:0/4098152947 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0317d0 con 0x7f663406df00 2024-08-17T02:26:40.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 -- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 msgr2=0x7f66340ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f66340ad9b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f662c009f20 tx=0x7f662c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 -- 172.21.15.146:0/4098152947 shutdown_connections 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f66340ad9b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 --2- 172.21.15.146:0/4098152947 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155a20 0x7f66340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 -- 172.21.15.146:0/4098152947 >> 172.21.15.146:0/4098152947 conn(0x7f66340cb9b0 msgr2=0x7f66340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 -- 172.21.15.146:0/4098152947 shutdown_connections 2024-08-17T02:26:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.019+0000 7f6639e00640 1 -- 172.21.15.146:0/4098152947 wait complete. 2024-08-17T02:26:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.021+0000 7f6639e00640 1 Processor -- start 2024-08-17T02:26:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.021+0000 7f6639e00640 1 -- start start 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f663414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155df0 0x7f663416cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66341491c0 con 0x7f6634155a20 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663414bcf0 con 0x7f663406df00 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6639e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663414bfd0 con 0x7f6634155df0 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6632000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6632a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f663414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6632000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39252/0 (socket says 172.21.15.146:39252) 2024-08-17T02:26:40.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6632000640 1 -- 172.21.15.146:0/4080301912 learned_addr learned my addr 172.21.15.146:0/4080301912 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.022+0000 7f6633400640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155df0 0x7f663416cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 -- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155df0 msgr2=0x7f663416cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155df0 0x7f663416cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 -- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 msgr2=0x7f663414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f663414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 -- 172.21.15.146:0/4080301912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009390 con 0x7f6634155a20 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632a00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f663414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:40.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6632000640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f662000c4c0 tx=0x7f6620007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011590 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620011710 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c009ae0 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011ad0 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.023+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663416cad0 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.024+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663414c1f0 con 0x7f6634155a20 2024-08-17T02:26:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.025+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f662001b3b0 con 0x7f6634155a20 2024-08-17T02:26:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.026+0000 7f662a000640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 0x7f6614067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.026+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66200819a0 con 0x7f6634155a20 2024-08-17T02:26:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.026+0000 7f6632a00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 0x7f6614067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.027+0000 7f6632a00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 0x7f6614067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6624011580 tx=0x7f66240090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.030+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f662004fa70 con 0x7f6634155a20 2024-08-17T02:26:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.240+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6634064db0 con 0x7f6634155a20 2024-08-17T02:26:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.241+0000 7f662a000640 1 -- 172.21.15.146:0/4080301912 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f6620017070 con 0x7f6634155a20 2024-08-17T02:26:40.242 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:40.242 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 msgr2=0x7f6614067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 0x7f6614067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6624011580 tx=0x7f66240090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 msgr2=0x7f663414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f662000c4c0 tx=0x7f6620007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 shutdown_connections 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6614065150 0x7f6614067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6634155a20 0x7f663414f2b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6634155df0 0x7f663416cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 --2- 172.21.15.146:0/4080301912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f663406df00 0x7f663414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.243+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 >> 172.21.15.146:0/4080301912 conn(0x7f66340cb9b0 msgr2=0x7f6634156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.244+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 shutdown_connections 2024-08-17T02:26:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.244+0000 7f6639e00640 1 -- 172.21.15.146:0/4080301912 wait complete. 2024-08-17T02:26:40.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.413+0000 7fd952a00640 1 Processor -- start 2024-08-17T02:26:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.413+0000 7fd952a00640 1 -- start start 2024-08-17T02:26:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd952a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94c158d60 0x7fd94c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd952a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0b18d0 con 0x7fd94c15cb30 2024-08-17T02:26:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd952a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0b0d00 con 0x7fd94c0c7420 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd952a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0b0fa0 con 0x7fd94c158d60 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd94be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94c158d60 0x7fd94c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd94be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd94c158d60 0x7fd94c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39254/0 (socket says 172.21.15.146:39254) 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd94be00640 1 -- 172.21.15.146:0/2226089300 learned_addr learned my addr 172.21.15.146:0/2226089300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.414+0000 7fd94b400640 1 --1- 172.21.15.146:0/2226089300 >> v1:172.21.15.146:6789/0 conn(0x7fd94c15cb30 0x7fd94c0c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46436/0 (socket says 172.21.15.146:46436) 2024-08-17T02:26:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.415+0000 7fd94be00640 1 -- 172.21.15.146:0/2226089300 >> v1:172.21.15.150:6789/0 conn(0x7fd94c0c7420 legacy=0x7fd94c096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.415+0000 7fd94be00640 1 -- 172.21.15.146:0/2226089300 >> v1:172.21.15.146:6789/0 conn(0x7fd94c15cb30 legacy=0x7fd94c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.415+0000 7fd94be00640 1 -- 172.21.15.146:0/2226089300 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0b1280 con 0x7fd94c158d60 2024-08-17T02:26:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.416+0000 7fd94be00640 1 --2- 172.21.15.146:0/2226089300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c158d60 0x7fd94c0b1d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009940 tx=0x7fd93c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3372df262765ab0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.416+0000 7fd94aa00640 1 -- 172.21.15.146:0/2226089300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c02ae40 con 0x7fd94c158d60 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.416+0000 7fd94aa00640 1 -- 172.21.15.146:0/2226089300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c032440 con 0x7fd94c158d60 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.416+0000 7fd94aa00640 1 -- 172.21.15.146:0/2226089300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c032820 con 0x7fd94c158d60 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 -- 172.21.15.146:0/2226089300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c158d60 msgr2=0x7fd94c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 --2- 172.21.15.146:0/2226089300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c158d60 0x7fd94c0b1d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009940 tx=0x7fd93c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 -- 172.21.15.146:0/2226089300 shutdown_connections 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 --2- 172.21.15.146:0/2226089300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c158d60 0x7fd94c0b1d60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 -- 172.21.15.146:0/2226089300 >> 172.21.15.146:0/2226089300 conn(0x7fd94c0b3040 msgr2=0x7fd94c0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 -- 172.21.15.146:0/2226089300 shutdown_connections 2024-08-17T02:26:40.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.417+0000 7fd952a00640 1 -- 172.21.15.146:0/2226089300 wait complete. 2024-08-17T02:26:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.418+0000 7fd952a00640 1 Processor -- start 2024-08-17T02:26:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.418+0000 7fd952a00640 1 -- start start 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 0x7fd94c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 0x7fd94c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c09b610 con 0x7fd94c0c7420 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0982f0 con 0x7fd94c158d60 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd952a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0985d0 con 0x7fd94c15cb30 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd94be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.419+0000 7fd94be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39256/0 (socket says 172.21.15.146:39256) 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 -- 172.21.15.146:0/2684795525 learned_addr learned my addr 172.21.15.146:0/2684795525 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94b400640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 0x7fd94c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd950a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 0x7fd94c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 -- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 msgr2=0x7fd94c151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 0x7fd94c151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 -- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 msgr2=0x7fd94c153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 0x7fd94c153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 -- 172.21.15.146:0/2684795525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009450 con 0x7fd94c0c7420 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94b400640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 0x7fd94c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd950a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 0x7fd94c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.420+0000 7fd94be00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd93c035040 tx=0x7fd93c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.421+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c031de0 con 0x7fd94c0c7420 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.421+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c03d420 con 0x7fd94c0c7420 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.421+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c03d7e0 con 0x7fd94c0c7420 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.421+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c0988b0 con 0x7fd94c0c7420 2024-08-17T02:26:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.421+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c16aec0 con 0x7fd94c0c7420 2024-08-17T02:26:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.422+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c064db0 con 0x7fd94c0c7420 2024-08-17T02:26:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.423+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd93c039040 con 0x7fd94c0c7420 2024-08-17T02:26:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.423+0000 7fd943400640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 0x7fd92c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.424+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd93c02ae40 con 0x7fd94c0c7420 2024-08-17T02:26:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.424+0000 7fd94b400640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 0x7fd92c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.424+0000 7fd94b400640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 0x7fd92c067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0cec90 tx=0x7fd938007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.432+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd93c070560 con 0x7fd94c0c7420 2024-08-17T02:26:40.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.616+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd94c069af0 con 0x7fd94c0c7420 2024-08-17T02:26:40.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.617+0000 7fd943400640 1 -- 172.21.15.146:0/2684795525 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd93c073b80 con 0x7fd94c0c7420 2024-08-17T02:26:40.619 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:40.619 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:40.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 msgr2=0x7fd92c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 0x7fd92c067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0cec90 tx=0x7fd938007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:40.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 msgr2=0x7fd94c16a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd93c035040 tx=0x7fd93c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 shutdown_connections 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd92c065150 0x7fd92c067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd94c15cb30 0x7fd94c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd94c158d60 0x7fd94c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 --2- 172.21.15.146:0/2684795525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd94c0c7420 0x7fd94c16a980 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 >> 172.21.15.146:0/2684795525 conn(0x7fd94c0b3040 msgr2=0x7fd94c156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 shutdown_connections 2024-08-17T02:26:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.620+0000 7fd952a00640 1 -- 172.21.15.146:0/2684795525 wait complete. 2024-08-17T02:26:40.638 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:26:40.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.790+0000 7f4660600640 1 Processor -- start 2024-08-17T02:26:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.790+0000 7f4660600640 1 -- start start 2024-08-17T02:26:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.791+0000 7f4660600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46580b1440 0x7f46580caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.791+0000 7f4660600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580caa80 con 0x7f46581401b0 2024-08-17T02:26:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.791+0000 7f4660600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580c9e70 con 0x7f4658140580 2024-08-17T02:26:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.791+0000 7f4660600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580cb450 con 0x7f46580b1440 2024-08-17T02:26:40.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46580b1440 0x7f46580caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465dc00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f46581401b0 0x7f46580b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46438/0 (socket says 172.21.15.146:46438) 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465dc00640 1 -- 172.21.15.146:0/3107473134 learned_addr learned my addr 172.21.15.146:0/3107473134 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46580b1440 0x7f46580caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39262/0 (socket says 172.21.15.146:39262) 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465d200640 1 -- 172.21.15.146:0/3107473134 >> v1:172.21.15.150:6789/0 conn(0x7f4658140580 legacy=0x7f46580c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465d200640 1 -- 172.21.15.146:0/3107473134 >> v1:172.21.15.146:6789/0 conn(0x7f46581401b0 legacy=0x7f46580b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f465d200640 1 -- 172.21.15.146:0/3107473134 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580ca150 con 0x7f46580b1440 2024-08-17T02:26:40.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.792+0000 7f4657e00640 1 -- 172.21.15.146:0/3107473134 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240250814 0 0) 0x7f46580caa80 con 0x7f46581401b0 2024-08-17T02:26:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.793+0000 7f465d200640 1 --2- 172.21.15.146:0/3107473134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f46580caf10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4644009850 tx=0x7f46440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845cd25542789ee2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.793+0000 7f4657e00640 1 -- 172.21.15.146:0/3107473134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464402ae20 con 0x7f46580b1440 2024-08-17T02:26:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.793+0000 7f4657e00640 1 -- 172.21.15.146:0/3107473134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644032440 con 0x7f46580b1440 2024-08-17T02:26:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.793+0000 7f4657e00640 1 -- 172.21.15.146:0/3107473134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440327e0 con 0x7f46580b1440 2024-08-17T02:26:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 -- 172.21.15.146:0/3107473134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 msgr2=0x7f46580caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 --2- 172.21.15.146:0/3107473134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f46580caf10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4644009850 tx=0x7f46440090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 -- 172.21.15.146:0/3107473134 shutdown_connections 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 --2- 172.21.15.146:0/3107473134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f46580caf10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 -- 172.21.15.146:0/3107473134 >> 172.21.15.146:0/3107473134 conn(0x7f46580cb9b0 msgr2=0x7f46580cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 -- 172.21.15.146:0/3107473134 shutdown_connections 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.794+0000 7f4660600640 1 -- 172.21.15.146:0/3107473134 wait complete. 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.795+0000 7f4660600640 1 Processor -- start 2024-08-17T02:26:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 -- start start 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46581401b0 0x7f4658169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4658140580 0x7f46580c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465816c2e0 con 0x7f46580b1440 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465816d140 con 0x7f46581401b0 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.796+0000 7f4660600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4658169c90 con 0x7f4658140580 2024-08-17T02:26:40.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39266/0 (socket says 172.21.15.146:39266) 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 -- 172.21.15.146:0/728517521 learned_addr learned my addr 172.21.15.146:0/728517521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465d200640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46581401b0 0x7f4658169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465e600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4658140580 0x7f46580c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 -- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4658140580 msgr2=0x7f46580c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4658140580 0x7f46580c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 -- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46581401b0 msgr2=0x7f4658169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46581401b0 0x7f4658169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 -- 172.21.15.146:0/728517521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009390 con 0x7f46580b1440 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.797+0000 7f465dc00640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c640 tx=0x7f464c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.798+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c005aa0 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.798+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c005c00 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.798+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465816c530 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.798+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0070f0 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.798+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465816caf0 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.799+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4658064db0 con 0x7f46580b1440 2024-08-17T02:26:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.800+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f464c007520 con 0x7f46580b1440 2024-08-17T02:26:40.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.801+0000 7f4654c00640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 0x7f4638067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:40.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.801+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f464c081d00 con 0x7f46580b1440 2024-08-17T02:26:40.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.801+0000 7f465d200640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 0x7f4638067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:40.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.802+0000 7f465d200640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 0x7f4638067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4644034000 tx=0x7f4644032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:40.808+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f464c04fef0 con 0x7f46580b1440 2024-08-17T02:26:41.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.028+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f465806da70 con 0x7f46580b1440 2024-08-17T02:26:41.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.028+0000 7f4654c00640 1 -- 172.21.15.146:0/728517521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f464c053510 con 0x7f46580b1440 2024-08-17T02:26:41.030 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:41.030 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:41.030 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 msgr2=0x7f4638067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 0x7f4638067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4644034000 tx=0x7f4644032000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 msgr2=0x7f465815abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f464c00c640 tx=0x7f464c007d00 comp rx=0 tx=0).stop 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 shutdown_connections 2024-08-17T02:26:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4638065150 0x7f4638067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4658140580 0x7f46580c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46581401b0 0x7f4658169750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 --2- 172.21.15.146:0/728517521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46580b1440 0x7f465815abc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 >> 172.21.15.146:0/728517521 conn(0x7f46580cb9b0 msgr2=0x7f4658069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 shutdown_connections 2024-08-17T02:26:41.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.031+0000 7f4660600640 1 -- 172.21.15.146:0/728517521 wait complete. 2024-08-17T02:26:41.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.197+0000 7f1962600640 1 Processor -- start 2024-08-17T02:26:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.197+0000 7f1962600640 1 -- start start 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.198+0000 7f1962600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f195c155900 0x7f195c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.198+0000 7f1962600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f195c0b0270 0x7f195c156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.198+0000 7f1962600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c157690 con 0x7f195c157b20 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.198+0000 7f1962600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c156a80 con 0x7f195c0b0270 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.198+0000 7f1962600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c156d60 con 0x7f195c155900 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f195c0b0270 0x7f195c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f195c0b0270 0x7f195c156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39270/0 (socket says 172.21.15.146:39270) 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 -- 172.21.15.146:0/1109284267 learned_addr learned my addr 172.21.15.146:0/1109284267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f1961200640 1 --2- 172.21.15.146:0/1109284267 >> v2:172.21.15.150:3300/0 conn(0x7f195c155900 0x7f195c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 -- 172.21.15.146:0/1109284267 >> v2:172.21.15.150:3300/0 conn(0x7f195c155900 msgr2=0x7f195c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 --2- 172.21.15.146:0/1109284267 >> v2:172.21.15.150:3300/0 conn(0x7f195c155900 0x7f195c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 -- 172.21.15.146:0/1109284267 >> v1:172.21.15.150:6789/0 conn(0x7f195c157b20 legacy=0x7f195c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.199+0000 7f195be00640 1 -- 172.21.15.146:0/1109284267 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c157040 con 0x7f195c0b0270 2024-08-17T02:26:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.200+0000 7f195be00640 1 --2- 172.21.15.146:0/1109284267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c0b0270 0x7f195c156210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f195c065fd0 tx=0x7f19480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8e9af86ebb3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.200+0000 7f195b400640 1 -- 172.21.15.146:0/1109284267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194802adf0 con 0x7f195c0b0270 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.200+0000 7f195b400640 1 -- 172.21.15.146:0/1109284267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948032440 con 0x7f195c0b0270 2024-08-17T02:26:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.200+0000 7f195b400640 1 -- 172.21.15.146:0/1109284267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948032820 con 0x7f195c0b0270 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 -- 172.21.15.146:0/1109284267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c0b0270 msgr2=0x7f195c156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 --2- 172.21.15.146:0/1109284267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c0b0270 0x7f195c156210 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f195c065fd0 tx=0x7f19480091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 -- 172.21.15.146:0/1109284267 shutdown_connections 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 --2- 172.21.15.146:0/1109284267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c0b0270 0x7f195c156210 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 --2- 172.21.15.146:0/1109284267 >> v2:172.21.15.150:3300/0 conn(0x7f195c155900 0x7f195c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 -- 172.21.15.146:0/1109284267 >> 172.21.15.146:0/1109284267 conn(0x7f195c067750 msgr2=0x7f195c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 -- 172.21.15.146:0/1109284267 shutdown_connections 2024-08-17T02:26:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.201+0000 7f1962600640 1 -- 172.21.15.146:0/1109284267 wait complete. 2024-08-17T02:26:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.203+0000 7f1962600640 1 Processor -- start 2024-08-17T02:26:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.203+0000 7f1962600640 1 -- start start 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.203+0000 7f1962600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f195c0b0270 0x7f195c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1962600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1962600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 0x7f195c068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1962600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c7120 con 0x7f195c155900 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1962600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0cb1f0 con 0x7f195c0b0270 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1962600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c16c370 con 0x7f195c157b20 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39284/0 (socket says 172.21.15.146:39284) 2024-08-17T02:26:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 -- 172.21.15.146:0/369299261 learned_addr learned my addr 172.21.15.146:0/369299261 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1961200640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f195c0b0270 0x7f195c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1961c00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 0x7f195c068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 -- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 msgr2=0x7f195c068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 0x7f195c068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 -- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f195c0b0270 msgr2=0x7f195c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f195c0b0270 0x7f195c0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f195be00640 1 -- 172.21.15.146:0/369299261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009450 con 0x7f195c155900 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.204+0000 7f1961c00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 0x7f195c068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f195be00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1948009940 tx=0x7f1948032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948000c90 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948031a60 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c16c650 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948031e60 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.205+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c16cc10 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.206+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c16cdd0 con 0x7f195c155900 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.207+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1948039040 con 0x7f195c155900 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.208+0000 7f194fe00640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.208+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19480a23e0 con 0x7f195c155900 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.208+0000 7f1961200640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.209+0000 7f1961200640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1950009d20 tx=0x7f19500090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.215+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19480704b0 con 0x7f195c155900 2024-08-17T02:26:41.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.429+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f195c071050 con 0x7f195c155900 2024-08-17T02:26:41.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.430+0000 7f194fe00640 1 -- 172.21.15.146:0/369299261 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4603 (secure 0 0 0) 0x7f1948073ad0 con 0x7f195c155900 2024-08-17T02:26:41.431 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:41.431 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2054918673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2054918673},{"type":"v1","addr":"172.21.15.150:6834","nonce":2054918673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/3821592480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":3821592480},{"type":"v1","addr":"172.21.15.150:6835","nonce":3821592480}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3374474982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3374474982},{"type":"v1","addr":"172.21.15.146:6836","nonce":3374474982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:03.077692+0000","modified":"2024-08-17T02:26:06.695058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/3496457616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3496457616},{"type":"v1","addr":"172.21.15.146:6837","nonce":3496457616}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:26:41.432 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 8 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 msgr2=0x7f193c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1950009d20 tx=0x7f19500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 msgr2=0x7f195c068540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1948009940 tx=0x7f1948032000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 shutdown_connections 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195c155900 0x7f195c068540 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f195c157b20 0x7f195c068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 --2- 172.21.15.146:0/369299261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f195c0b0270 0x7f195c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.432+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 >> 172.21.15.146:0/369299261 conn(0x7f195c067750 msgr2=0x7f195c0af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.433+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 shutdown_connections 2024-08-17T02:26:41.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.433+0000 7f1962600640 1 -- 172.21.15.146:0/369299261 wait complete. 2024-08-17T02:26:41.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.601+0000 7fd0acc00640 1 Processor -- start 2024-08-17T02:26:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.602+0000 7fd0acc00640 1 -- start start 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0acc00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0a8159ca0 0x7fd0a80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0acc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80cadc0 con 0x7fd0a80ccad0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0acc00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80cd6e0 con 0x7fd0a8159ca0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0acc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80ccf70 con 0x7fd0a80ca8a0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd0a80ccad0 0x7fd0a80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46450/0 (socket says 172.21.15.146:46450) 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a7e00640 1 -- 172.21.15.146:0/3481603111 learned_addr learned my addr 172.21.15.146:0/3481603111 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a7400640 1 --2- 172.21.15.146:0/3481603111 >> v2:172.21.15.150:3300/0 conn(0x7fd0a8159ca0 0x7fd0a80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a6a00640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a6000640 1 -- 172.21.15.146:0/3481603111 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353694478 0 0) 0x7fd0a80cadc0 con 0x7fd0a80ccad0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.603+0000 7fd0a6000640 1 -- 172.21.15.146:0/3481603111 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0034e0 con 0x7fd0a80ccad0 2024-08-17T02:26:41.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.604+0000 7fd0a7400640 1 -- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 msgr2=0x7fd0a80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.604+0000 7fd0a7400640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a80cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.604+0000 7fd0a7400640 1 -- 172.21.15.146:0/3481603111 >> v1:172.21.15.146:6789/0 conn(0x7fd0a80ccad0 legacy=0x7fd0a80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.604+0000 7fd0a7400640 1 -- 172.21.15.146:0/3481603111 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80cb060 con 0x7fd0a8159ca0 2024-08-17T02:26:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.605+0000 7fd0a7400640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80ca360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd098009850 tx=0x7fd0980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ec5a91c8ae5020 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.605+0000 7fd0a6000640 1 -- 172.21.15.146:0/3481603111 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09802adb0 con 0x7fd0a8159ca0 2024-08-17T02:26:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.605+0000 7fd0a6000640 1 -- 172.21.15.146:0/3481603111 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098032440 con 0x7fd0a8159ca0 2024-08-17T02:26:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.605+0000 7fd0a6000640 1 -- 172.21.15.146:0/3481603111 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098032820 con 0x7fd0a8159ca0 2024-08-17T02:26:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 -- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 msgr2=0x7fd0a80ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80ca360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd098009850 tx=0x7fd0980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 -- 172.21.15.146:0/3481603111 shutdown_connections 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 --2- 172.21.15.146:0/3481603111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80ca360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 -- 172.21.15.146:0/3481603111 >> 172.21.15.146:0/3481603111 conn(0x7fd0a8098e00 msgr2=0x7fd0a806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 -- 172.21.15.146:0/3481603111 shutdown_connections 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.606+0000 7fd0acc00640 1 -- 172.21.15.146:0/3481603111 wait complete. 2024-08-17T02:26:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.607+0000 7fd0acc00640 1 Processor -- start 2024-08-17T02:26:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.607+0000 7fd0acc00640 1 -- start start 2024-08-17T02:26:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a809a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a809a670 con 0x7fd0a80ccad0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8156640 con 0x7fd0a8159ca0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0acc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a809c030 con 0x7fd0a80ca8a0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39294/0 (socket says 172.21.15.146:39294) 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.608+0000 7fd0a6a00640 1 -- 172.21.15.146:0/1951532434 learned_addr learned my addr 172.21.15.146:0/1951532434 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a7400640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a809a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a7e00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 -- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 msgr2=0x7fd0a809a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a809a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 -- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 msgr2=0x7fd0a80c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 -- 172.21.15.146:0/1951532434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009390 con 0x7fd0a80ccad0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0a6a00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd09400ea20 tx=0x7fd0940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09400ca10 con 0x7fd0a80ccad0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09400cb70 con 0x7fd0a80ccad0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094013470 con 0x7fd0a80ccad0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.609+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a809c310 con 0x7fd0a80ccad0 2024-08-17T02:26:41.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.610+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a809c8d0 con 0x7fd0a80ccad0 2024-08-17T02:26:41.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.611+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8071050 con 0x7fd0a80ccad0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.611+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd094013860 con 0x7fd0a80ccad0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.612+0000 7fd09ea00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 0x7fd088067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.612+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd094082940 con 0x7fd0a80ccad0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.613+0000 7fd0a7400640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 0x7fd088067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.613+0000 7fd0a7400640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 0x7fd088067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd098034000 tx=0x7fd098032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.617+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd094050a20 con 0x7fd0a80ccad0 2024-08-17T02:26:41.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.791+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0a8089bd0 con 0x7fd0a80ccad0 2024-08-17T02:26:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.792+0000 7fd09ea00640 1 -- 172.21.15.146:0/1951532434 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fd094054040 con 0x7fd0a80ccad0 2024-08-17T02:26:41.793 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:41.793 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:04.676911+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:01.321612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:02.063578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 msgr2=0x7fd088067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 0x7fd088067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd098034000 tx=0x7fd098032000 comp rx=0 tx=0).stop 2024-08-17T02:26:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 msgr2=0x7fd0a8156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd09400ea20 tx=0x7fd0940090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 shutdown_connections 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd088065150 0x7fd088067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0a80ccad0 0x7fd0a8156100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0a8159ca0 0x7fd0a80c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 --2- 172.21.15.146:0/1951532434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0a80ca8a0 0x7fd0a809a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 >> 172.21.15.146:0/1951532434 conn(0x7fd0a8098e00 msgr2=0x7fd0a80ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 shutdown_connections 2024-08-17T02:26:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.794+0000 7fd0acc00640 1 -- 172.21.15.146:0/1951532434 wait complete. 2024-08-17T02:26:41.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:26:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.960+0000 7ff139600640 1 Processor -- start 2024-08-17T02:26:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.960+0000 7ff139600640 1 -- start start 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1341401b0 0x7ff1340caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 0x7ff1340b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1340b1270 0x7ff1340c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340cb450 con 0x7ff1341401b0 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340b16d0 con 0x7ff134140580 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff139600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340caa80 con 0x7ff1340b1270 2024-08-17T02:26:41.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff132a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1341401b0 0x7ff1340caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.961+0000 7ff132a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1341401b0 0x7ff1340caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39308/0 (socket says 172.21.15.146:39308) 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 -- 172.21.15.146:0/2876636820 learned_addr learned my addr 172.21.15.146:0/2876636820 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132000640 1 --2- 172.21.15.146:0/2876636820 >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 0x7ff1340b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff133400640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1340b1270 0x7ff1340c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 -- 172.21.15.146:0/2876636820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1340b1270 msgr2=0x7ff1340c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1340b1270 0x7ff1340c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 -- 172.21.15.146:0/2876636820 >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 msgr2=0x7ff1340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 --2- 172.21.15.146:0/2876636820 >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 0x7ff1340b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132a00640 1 -- 172.21.15.146:0/2876636820 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340c9e70 con 0x7ff1341401b0 2024-08-17T02:26:41.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.962+0000 7ff132000640 1 --2- 172.21.15.146:0/2876636820 >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 0x7ff1340b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.963+0000 7ff132a00640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1341401b0 0x7ff1340caf10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff13406aa80 tx=0x7ff1240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9538fae34b04d2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.963+0000 7ff131600640 1 -- 172.21.15.146:0/2876636820 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12402ad40 con 0x7ff1341401b0 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.963+0000 7ff131600640 1 -- 172.21.15.146:0/2876636820 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124032440 con 0x7ff1341401b0 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.963+0000 7ff131600640 1 -- 172.21.15.146:0/2876636820 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12402aea0 con 0x7ff1341401b0 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 -- 172.21.15.146:0/2876636820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1341401b0 msgr2=0x7ff1340caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1341401b0 0x7ff1340caf10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff13406aa80 tx=0x7ff1240091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 -- 172.21.15.146:0/2876636820 shutdown_connections 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1340b1270 0x7ff1340c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 --2- 172.21.15.146:0/2876636820 >> v2:172.21.15.150:3300/0 conn(0x7ff134140580 0x7ff1340b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 --2- 172.21.15.146:0/2876636820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1341401b0 0x7ff1340caf10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 -- 172.21.15.146:0/2876636820 >> 172.21.15.146:0/2876636820 conn(0x7ff1340cb9b0 msgr2=0x7ff1340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:41.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 -- 172.21.15.146:0/2876636820 shutdown_connections 2024-08-17T02:26:41.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.964+0000 7ff139600640 1 -- 172.21.15.146:0/2876636820 wait complete. 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.965+0000 7ff139600640 1 Processor -- start 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.965+0000 7ff139600640 1 -- start start 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1341401b0 0x7ff1340af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 0x7ff13413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ab4e0 con 0x7ff1340b1270 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ab7c0 con 0x7ff1341401b0 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff139600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340abaa0 con 0x7ff134140580 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff132a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39324/0 (socket says 172.21.15.146:39324) 2024-08-17T02:26:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.966+0000 7ff132a00640 1 -- 172.21.15.146:0/4085667658 learned_addr learned my addr 172.21.15.146:0/4085667658 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132000640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1341401b0 0x7ff1340af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff133400640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 0x7ff13413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 -- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 msgr2=0x7ff13413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 0x7ff13413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 -- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1341401b0 msgr2=0x7ff1340af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1341401b0 0x7ff1340af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 -- 172.21.15.146:0/4085667658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009450 con 0x7ff1340b1270 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff133400640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 0x7ff13413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff132a00640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff124009210 tx=0x7ff124032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124000ce0 con 0x7ff1340b1270 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff124031a60 con 0x7ff1340b1270 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124031e40 con 0x7ff1340b1270 2024-08-17T02:26:41.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.967+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1340abd80 con 0x7ff1340b1270 2024-08-17T02:26:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.968+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340ab160 con 0x7ff1340b1270 2024-08-17T02:26:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.969+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff134064db0 con 0x7ff1340b1270 2024-08-17T02:26:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.969+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff124039040 con 0x7ff1340b1270 2024-08-17T02:26:41.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.970+0000 7ff12a000640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 0x7ff114067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.970+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1240a2070 con 0x7ff1340b1270 2024-08-17T02:26:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.970+0000 7ff132000640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 0x7ff114067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.971+0000 7ff132000640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 0x7ff114067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1340c9d70 tx=0x7ff120008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:41.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:41.974+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff1240701e0 con 0x7ff1340b1270 2024-08-17T02:26:42.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.183+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff1340ab620 con 0x7ff1340b1270 2024-08-17T02:26:42.185 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-08-17T02:26:42.184+0000 7fd403600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:26:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.192+0000 7ff12a000640 1 -- 172.21.15.146:0/4085667658 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff1340ab620 con 0x7ff1340b1270 2024-08-17T02:26:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.194+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 msgr2=0x7ff114067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.194+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 0x7ff114067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1340c9d70 tx=0x7ff120008040 comp rx=0 tx=0).stop 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.194+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 msgr2=0x7ff1340aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.194+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff124009210 tx=0x7ff124032000 comp rx=0 tx=0).stop 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 shutdown_connections 2024-08-17T02:26:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff114065150 0x7ff114067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff134140580 0x7ff13413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1341401b0 0x7ff1340af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 --2- 172.21.15.146:0/4085667658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1340b1270 0x7ff1340aac20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 >> 172.21.15.146:0/4085667658 conn(0x7ff1340cb9b0 msgr2=0x7ff13413edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 shutdown_connections 2024-08-17T02:26:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.195+0000 7ff139600640 1 -- 172.21.15.146:0/4085667658 wait complete. 2024-08-17T02:26:42.197 INFO:tasks.ceph.mds.c.smithi146.stderr: -1996> 2024-08-17T02:26:07.470+0000 7f6c15600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:42.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:26:42.236 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-08-17T02:26:42.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.364+0000 7f6a63400640 1 Processor -- start 2024-08-17T02:26:42.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.364+0000 7f6a63400640 1 -- start start 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.365+0000 7f6a63400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6a5c156990 0x7f6a5c0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a63400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c15b030 con 0x7f6a5c0adec0 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a63400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0cc2e0 con 0x7f6a5c156d60 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a63400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b1110 con 0x7f6a5c156990 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a61400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a5c0adec0 0x7f6a5c0ae940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46460/0 (socket says 172.21.15.146:46460) 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a61400640 1 -- 172.21.15.146:0/963042922 learned_addr learned my addr 172.21.15.146:0/963042922 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:42.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a60a00640 1 --2- 172.21.15.146:0/963042922 >> v2:172.21.15.150:3300/0 conn(0x7f6a5c156990 0x7f6a5c0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892297178 0 0) 0x7f6a5c15b030 con 0x7f6a5c0adec0 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a400034e0 con 0x7f6a5c0adec0 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378730242 0 0) 0x7f6a5c0cc2e0 con 0x7f6a5c156d60 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.366+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a5c15b030 con 0x7f6a5c156d60 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.367+0000 7f6a60a00640 1 -- 172.21.15.146:0/963042922 >> v1:172.21.15.150:6789/0 conn(0x7f6a5c156d60 legacy=0x7f6a5c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.367+0000 7f6a60a00640 1 -- 172.21.15.146:0/963042922 >> v1:172.21.15.146:6789/0 conn(0x7f6a5c0adec0 legacy=0x7f6a5c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.367+0000 7f6a60a00640 1 -- 172.21.15.146:0/963042922 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c15a700 con 0x7f6a5c156990 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a60a00640 1 --2- 172.21.15.146:0/963042922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c156990 0x7f6a5c0b05a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009850 tx=0x7f6a4c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0122808afd6457 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c02ae20 con 0x7f6a5c156990 2024-08-17T02:26:42.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c032440 con 0x7f6a5c156990 2024-08-17T02:26:42.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a5be00640 1 -- 172.21.15.146:0/963042922 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0327e0 con 0x7f6a5c156990 2024-08-17T02:26:42.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a63400640 1 -- 172.21.15.146:0/963042922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c156990 msgr2=0x7f6a5c0b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.368+0000 7f6a63400640 1 --2- 172.21.15.146:0/963042922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c156990 0x7f6a5c0b05a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009850 tx=0x7f6a4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.369+0000 7f6a63400640 1 -- 172.21.15.146:0/963042922 shutdown_connections 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.369+0000 7f6a63400640 1 --2- 172.21.15.146:0/963042922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c156990 0x7f6a5c0b05a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.369+0000 7f6a63400640 1 -- 172.21.15.146:0/963042922 >> 172.21.15.146:0/963042922 conn(0x7f6a5c067750 msgr2=0x7f6a5c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.369+0000 7f6a63400640 1 -- 172.21.15.146:0/963042922 shutdown_connections 2024-08-17T02:26:42.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.369+0000 7f6a63400640 1 -- 172.21.15.146:0/963042922 wait complete. 2024-08-17T02:26:42.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.370+0000 7f6a63400640 1 Processor -- start 2024-08-17T02:26:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.370+0000 7f6a63400640 1 -- start start 2024-08-17T02:26:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c0adec0 0x7f6a5c069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a5c156990 0x7f6a5c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c069f80 con 0x7f6a5c156d60 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1576b0 con 0x7f6a5c0adec0 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a63400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1584f0 con 0x7f6a5c156990 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a61400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a61400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39344/0 (socket says 172.21.15.146:39344) 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a61400640 1 -- 172.21.15.146:0/3312680498 learned_addr learned my addr 172.21.15.146:0/3312680498 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a60a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c0adec0 0x7f6a5c069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.371+0000 7f6a53e00640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a5c156990 0x7f6a5c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 -- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a5c156990 msgr2=0x7f6a5c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a5c156990 0x7f6a5c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 -- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c0adec0 msgr2=0x7f6a5c069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:42.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c0adec0 0x7f6a5c069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:42.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 -- 172.21.15.146:0/3312680498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009390 con 0x7f6a5c156d60 2024-08-17T02:26:42.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a61400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400cc40 tx=0x7f6a54001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400ce60 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5400a850 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400ac10 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.372+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c158ec0 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.373+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c157ea0 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.374+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c158660 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.374+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a540070f0 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.375+0000 7f6a58c00640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 0x7f6a38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.376+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6a54082520 con 0x7f6a5c156d60 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.376+0000 7f6a60a00640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 0x7f6a38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:42.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.376+0000 7f6a60a00640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 0x7f6a38067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c034000 tx=0x7f6a4c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:42.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.380+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a54054170 con 0x7f6a5c156d60 2024-08-17T02:26:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:42.588+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a5c071050 con 0x7f6a5c156d60 2024-08-17T02:26:43.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.201+0000 7f6a58c00640 1 -- 172.21.15.146:0/3312680498 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a54053d00 con 0x7f6a5c156d60 2024-08-17T02:26:43.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.205+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 msgr2=0x7f6a38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.205+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 0x7f6a38067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c034000 tx=0x7f6a4c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:43.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.205+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 msgr2=0x7f6a5c158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.205+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400cc40 tx=0x7f6a54001a60 comp rx=0 tx=0).stop 2024-08-17T02:26:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 shutdown_connections 2024-08-17T02:26:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6a38065150 0x7f6a38067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c156d60 0x7f6a5c158980 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6a5c156990 0x7f6a5c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 --2- 172.21.15.146:0/3312680498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a5c0adec0 0x7f6a5c069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 >> 172.21.15.146:0/3312680498 conn(0x7f6a5c067750 msgr2=0x7f6a5c152270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 shutdown_connections 2024-08-17T02:26:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.206+0000 7f6a63400640 1 -- 172.21.15.146:0/3312680498 wait complete. 2024-08-17T02:26:43.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:26:43.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.416+0000 7f5c95e00640 1 Processor -- start 2024-08-17T02:26:43.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.416+0000 7f5c95e00640 1 -- start start 2024-08-17T02:26:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c95e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c90140520 0x7f5c900ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c95e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c900b3550 con 0x7f5c900aebd0 2024-08-17T02:26:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c95e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c900aefe0 con 0x7f5c90158120 2024-08-17T02:26:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c95e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c900b39e0 con 0x7f5c90140520 2024-08-17T02:26:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c8ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c90140520 0x7f5c900ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c8e000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5c900aebd0 0x7f5c900b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46472/0 (socket says 172.21.15.146:46472) 2024-08-17T02:26:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.417+0000 7f5c8e000640 1 -- 172.21.15.146:0/485791199 learned_addr learned my addr 172.21.15.146:0/485791199 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.418+0000 7f5c8ea00640 1 -- 172.21.15.146:0/485791199 >> v1:172.21.15.150:6789/0 conn(0x7f5c90158120 legacy=0x7f5c90160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.418+0000 7f5c8ea00640 1 -- 172.21.15.146:0/485791199 >> v1:172.21.15.146:6789/0 conn(0x7f5c900aebd0 legacy=0x7f5c900b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.418+0000 7f5c8ea00640 1 -- 172.21.15.146:0/485791199 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900b2940 con 0x7f5c90140520 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.418+0000 7f5c8d600640 1 -- 172.21.15.146:0/485791199 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789391560 0 0) 0x7f5c900b3550 con 0x7f5c900aebd0 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.419+0000 7f5c8ea00640 1 --2- 172.21.15.146:0/485791199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90140520 0x7f5c900ae690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009850 tx=0x7f5c800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3288d55ba0bc3615 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.419+0000 7f5c8d600640 1 -- 172.21.15.146:0/485791199 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80032440 con 0x7f5c90140520 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.419+0000 7f5c8d600640 1 -- 172.21.15.146:0/485791199 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c800325a0 con 0x7f5c90140520 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.419+0000 7f5c8d600640 1 -- 172.21.15.146:0/485791199 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80032940 con 0x7f5c90140520 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 -- 172.21.15.146:0/485791199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90140520 msgr2=0x7f5c900ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 --2- 172.21.15.146:0/485791199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90140520 0x7f5c900ae690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009850 tx=0x7f5c800090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 -- 172.21.15.146:0/485791199 shutdown_connections 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 --2- 172.21.15.146:0/485791199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90140520 0x7f5c900ae690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 -- 172.21.15.146:0/485791199 >> 172.21.15.146:0/485791199 conn(0x7f5c90096a70 msgr2=0x7f5c90096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 -- 172.21.15.146:0/485791199 shutdown_connections 2024-08-17T02:26:43.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.420+0000 7f5c95e00640 1 -- 172.21.15.146:0/485791199 wait complete. 2024-08-17T02:26:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.421+0000 7f5c95e00640 1 Processor -- start 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.421+0000 7f5c95e00640 1 -- start start 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c900aebd0 0x7f5c90156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c90140520 0x7f5c900aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90068b20 con 0x7f5c90158120 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90156960 con 0x7f5c900aebd0 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.422+0000 7f5c95e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c90067f10 con 0x7f5c90140520 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39358/0 (socket says 172.21.15.146:39358) 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 -- 172.21.15.146:0/3617009255 learned_addr learned my addr 172.21.15.146:0/3617009255 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8ea00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c900aebd0 0x7f5c90156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8e000640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c90140520 0x7f5c900aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 -- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c90140520 msgr2=0x7f5c900aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c90140520 0x7f5c900aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 -- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c900aebd0 msgr2=0x7f5c90156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c900aebd0 0x7f5c90156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 -- 172.21.15.146:0/3617009255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80009390 con 0x7f5c90158120 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c8f400640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c7f0 tx=0x7f5c880015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.423+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800a640 con 0x7f5c90158120 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.424+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8800a7c0 con 0x7f5c90158120 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.424+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8800ab80 con 0x7f5c90158120 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.424+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c900681f0 con 0x7f5c90158120 2024-08-17T02:26:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.424+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c900687b0 con 0x7f5c90158120 2024-08-17T02:26:43.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.425+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c90068cd0 con 0x7f5c90158120 2024-08-17T02:26:43.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.426+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c88003030 con 0x7f5c90158120 2024-08-17T02:26:43.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.426+0000 7f5c86000640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 0x7f5c70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:43.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.426+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f5c88082730 con 0x7f5c90158120 2024-08-17T02:26:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.427+0000 7f5c8ea00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 0x7f5c70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.427+0000 7f5c8ea00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 0x7f5c70067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c80034000 tx=0x7f5c80032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:43.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.431+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c90068cd0 con 0x7f5c90158120 2024-08-17T02:26:43.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:43.605+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c90068cd0 con 0x7f5c90158120 2024-08-17T02:26:44.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.204+0000 7f5c86000640 1 -- 172.21.15.146:0/3617009255 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5c90068cd0 con 0x7f5c90158120 2024-08-17T02:26:44.207 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.208+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 msgr2=0x7f5c70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.208+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 0x7f5c70067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c80034000 tx=0x7f5c80032000 comp rx=0 tx=0).stop 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.208+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 msgr2=0x7f5c9013dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.208+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800c7f0 tx=0x7f5c880015f0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 shutdown_connections 2024-08-17T02:26:44.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f5c70065150 0x7f5c70067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c90158120 0x7f5c9013dba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5c90140520 0x7f5c900aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 --2- 172.21.15.146:0/3617009255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c900aebd0 0x7f5c90156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.209+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 >> 172.21.15.146:0/3617009255 conn(0x7f5c90096a70 msgr2=0x7f5c9013b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.210+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 shutdown_connections 2024-08-17T02:26:44.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.211+0000 7f5c95e00640 1 -- 172.21.15.146:0/3617009255 wait complete. 2024-08-17T02:26:44.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:26:44.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.381+0000 7fe47c600640 1 Processor -- start 2024-08-17T02:26:44.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.381+0000 7fe47c600640 1 -- start start 2024-08-17T02:26:44.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.382+0000 7fe47c600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe474156890 0x7fe47406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.382+0000 7fe47c600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4740c8840 0x7fe47406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.382+0000 7fe47c600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4740ae9b0 con 0x7fe474156c60 2024-08-17T02:26:44.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.382+0000 7fe47c600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740aa730 con 0x7fe4740c8840 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.382+0000 7fe47c600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740aa9f0 con 0x7fe474156890 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe47a600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4740c8840 0x7fe47406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe479200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe474156c60 0x7fe4740c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46476/0 (socket says 172.21.15.146:46476) 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe479200640 1 -- 172.21.15.146:0/3460746318 learned_addr learned my addr 172.21.15.146:0/3460746318 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe479c00640 1 --2- 172.21.15.146:0/3460746318 >> v2:172.21.15.150:3300/0 conn(0x7fe474156890 0x7fe47406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe47a600640 1 -- 172.21.15.146:0/3460746318 >> v2:172.21.15.150:3300/0 conn(0x7fe474156890 msgr2=0x7fe47406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe47a600640 1 --2- 172.21.15.146:0/3460746318 >> v2:172.21.15.150:3300/0 conn(0x7fe474156890 0x7fe47406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe47a600640 1 -- 172.21.15.146:0/3460746318 >> v1:172.21.15.146:6789/0 conn(0x7fe474156c60 legacy=0x7fe4740c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe47a600640 1 -- 172.21.15.146:0/3460746318 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740ab320 con 0x7fe4740c8840 2024-08-17T02:26:44.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.383+0000 7fe473e00640 1 -- 172.21.15.146:0/3460746318 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086604540 0 0) 0x7fe4740ae9b0 con 0x7fe474156c60 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.384+0000 7fe47a600640 1 --2- 172.21.15.146:0/3460746318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4740c8840 0x7fe47406e420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe47406c5c0 tx=0x7fe46c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd67e66b6af46d0c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe473e00640 1 -- 172.21.15.146:0/3460746318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c007550 con 0x7fe4740c8840 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe473e00640 1 -- 172.21.15.146:0/3460746318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c02d050 con 0x7fe4740c8840 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe473e00640 1 -- 172.21.15.146:0/3460746318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0078e0 con 0x7fe4740c8840 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 -- 172.21.15.146:0/3460746318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4740c8840 msgr2=0x7fe47406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 --2- 172.21.15.146:0/3460746318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4740c8840 0x7fe47406e420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe47406c5c0 tx=0x7fe46c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 -- 172.21.15.146:0/3460746318 shutdown_connections 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 --2- 172.21.15.146:0/3460746318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4740c8840 0x7fe47406e420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 --2- 172.21.15.146:0/3460746318 >> v2:172.21.15.150:3300/0 conn(0x7fe474156890 0x7fe47406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 -- 172.21.15.146:0/3460746318 >> 172.21.15.146:0/3460746318 conn(0x7fe474067750 msgr2=0x7fe47406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 -- 172.21.15.146:0/3460746318 shutdown_connections 2024-08-17T02:26:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.385+0000 7fe47c600640 1 -- 172.21.15.146:0/3460746318 wait complete. 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.387+0000 7fe47c600640 1 Processor -- start 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.387+0000 7fe47c600640 1 -- start start 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c8840 0x7fe4741409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe474156890 0x7fe4740ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474140ff0 con 0x7fe474156c60 2024-08-17T02:26:44.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4741412d0 con 0x7fe474156890 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47c600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4741415b0 con 0x7fe4740c8840 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39368/0 (socket says 172.21.15.146:39368) 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 -- 172.21.15.146:0/2869051848 learned_addr learned my addr 172.21.15.146:0/2869051848 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe479c00640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c8840 0x7fe4741409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe479200640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe474156890 0x7fe4740ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 -- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c8840 msgr2=0x7fe4741409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c8840 0x7fe4741409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 -- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe474156890 msgr2=0x7fe4740ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe474156890 0x7fe4740ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.388+0000 7fe47a600640 1 -- 172.21.15.146:0/2869051848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009a20 con 0x7fe474156c60 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe47a600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0099f0 tx=0x7fe46c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0319e0 con 0x7fe474156c60 2024-08-17T02:26:44.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c040070 con 0x7fe474156c60 2024-08-17T02:26:44.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c031d50 con 0x7fe474156c60 2024-08-17T02:26:44.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe474141890 con 0x7fe474156c60 2024-08-17T02:26:44.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.389+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4740aceb0 con 0x7fe474156c60 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.390+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474141d90 con 0x7fe474156c60 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.391+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe46c042030 con 0x7fe474156c60 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.392+0000 7fe470c00640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 0x7fe454067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.392+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5469+0+0 (secure 0 0 0) 0x7fe46c0a3e00 con 0x7fe474156c60 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.392+0000 7fe479c00640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 0x7fe454067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:44.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.392+0000 7fe479c00640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 0x7fe454067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe46800bb40 tx=0x7fe468008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:44.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.396+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe46c071fc0 con 0x7fe474156c60 2024-08-17T02:26:44.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:44.575+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4740710c0 con 0x7fe474156c60 2024-08-17T02:26:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.209+0000 7fe470c00640 1 -- 172.21.15.146:0/2869051848 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe46c0755e0 con 0x7fe474156c60 2024-08-17T02:26:45.211 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 msgr2=0x7fe454067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 0x7fe454067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe46800bb40 tx=0x7fe468008040 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 msgr2=0x7fe474145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0099f0 tx=0x7fe46c037000 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 shutdown_connections 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe454065150 0x7fe454067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe474156c60 0x7fe474145b80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe474156890 0x7fe4740ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 --2- 172.21.15.146:0/2869051848 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4740c8840 0x7fe4741409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.212+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 >> 172.21.15.146:0/2869051848 conn(0x7fe474067750 msgr2=0x7fe474068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.213+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 shutdown_connections 2024-08-17T02:26:45.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.213+0000 7fe47c600640 1 -- 172.21.15.146:0/2869051848 wait complete. 2024-08-17T02:26:45.231 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:26:45.231 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:26:45.231 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:26:45.231 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:45.232 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:26:45.232 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:26:45.232 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:26:45.232 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:45.232 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:26:45.232 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:26:45.232 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:26:45.233 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:45.233 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:26:45.233 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:26:45.233 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:26:45.233 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:26:45.248 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:26:45.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:26:45.249 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:26:45.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:26:45.251 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:26:45.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:26:45.252 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:26:45.252 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:26:45.293 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:26:45.293 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:45.295 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:26:45.296 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:45.297 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:26:45.297 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:45.299 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:26:45.299 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:45.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:26:45.420 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-08-17T02:26:45.422 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-08-17T02:26:45.425 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-08-17T02:26:45.425 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-08-17T02:26:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.459+0000 7fe505800640 1 Processor -- start 2024-08-17T02:26:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.459+0000 7fe505800640 1 -- start start 2024-08-17T02:26:45.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.460+0000 7fe505800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5001401b0 0x7fe5000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.460+0000 7fe505800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5000caa80 con 0x7fe500140580 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.460+0000 7fe505800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5000c9e70 con 0x7fe5000b1440 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.460+0000 7fe505800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5000cb450 con 0x7fe5001401b0 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fe000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe500140580 0x7fe5000b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36258/0 (socket says 172.21.15.146:36258) 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fe000640 1 -- 172.21.15.146:0/2704303129 learned_addr learned my addr 172.21.15.146:0/2704303129 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fea00640 1 --2- 172.21.15.146:0/2704303129 >> v2:172.21.15.150:3300/0 conn(0x7fe5001401b0 0x7fe5000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431237221 0 0) 0x7fe5000caa80 con 0x7fe500140580 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e40034e0 con 0x7fe500140580 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fea00640 1 -- 172.21.15.146:0/2704303129 >> v1:172.21.15.150:6789/0 conn(0x7fe5000b1440 legacy=0x7fe5000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754395810 0 0) 0x7fe5000c9e70 con 0x7fe5000b1440 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fea00640 1 -- 172.21.15.146:0/2704303129 >> v1:172.21.15.146:6789/0 conn(0x7fe500140580 legacy=0x7fe5000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.461+0000 7fe4fea00640 1 -- 172.21.15.146:0/2704303129 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5000ca150 con 0x7fe5001401b0 2024-08-17T02:26:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.462+0000 7fe4fea00640 1 --2- 172.21.15.146:0/2704303129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5001401b0 0x7fe5000caf10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009850 tx=0x7fe4f00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f80dd9f6cbf914 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002ad90 con 0x7fe5001401b0 2024-08-17T02:26:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0032440 con 0x7fe5001401b0 2024-08-17T02:26:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe4fd600640 1 -- 172.21.15.146:0/2704303129 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00327c0 con 0x7fe5001401b0 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 -- 172.21.15.146:0/2704303129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5001401b0 msgr2=0x7fe5000caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 --2- 172.21.15.146:0/2704303129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5001401b0 0x7fe5000caf10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009850 tx=0x7fe4f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 -- 172.21.15.146:0/2704303129 shutdown_connections 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 --2- 172.21.15.146:0/2704303129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5001401b0 0x7fe5000caf10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 -- 172.21.15.146:0/2704303129 >> 172.21.15.146:0/2704303129 conn(0x7fe5000cb9b0 msgr2=0x7fe5000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 -- 172.21.15.146:0/2704303129 shutdown_connections 2024-08-17T02:26:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.463+0000 7fe505800640 1 -- 172.21.15.146:0/2704303129 wait complete. 2024-08-17T02:26:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.465+0000 7fe505800640 1 Processor -- start 2024-08-17T02:26:45.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.465+0000 7fe505800640 1 -- start start 2024-08-17T02:26:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 0x7fe5001676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 0x7fe5000a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000a6310 con 0x7fe5001401b0 2024-08-17T02:26:45.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000a92a0 con 0x7fe500140580 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe505800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000a88d0 con 0x7fe5000b1440 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe4fe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe4fe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47440/0 (socket says 172.21.15.146:47440) 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe4fe000640 1 -- 172.21.15.146:0/168921532 learned_addr learned my addr 172.21.15.146:0/168921532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe4ff400640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 0x7fe5000a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.466+0000 7fe4fea00640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 0x7fe5001676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 -- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 msgr2=0x7fe5001676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 0x7fe5001676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 -- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 msgr2=0x7fe5000a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 0x7fe5000a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 -- 172.21.15.146:0/168921532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009390 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fea00640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 0x7fe5001676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4ff400640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 0x7fe5000a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4fe000640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00c590 tx=0x7fe4ec007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec005aa0 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec005c00 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0070f0 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5000a7fa0 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.467+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5000a8560 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.468+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5000a8a40 con 0x7fe5001401b0 2024-08-17T02:26:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.469+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe4ec0074a0 con 0x7fe5001401b0 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.471+0000 7fe4f6000640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 0x7fe4e00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.471+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe4ec081ba0 con 0x7fe5001401b0 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.471+0000 7fe4fea00640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 0x7fe4e00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.471+0000 7fe4fea00640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 0x7fe4e00676d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.474+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4ec04ffc0 con 0x7fe5001401b0 2024-08-17T02:26:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:45.659+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe500064db0 con 0x7fe5001401b0 2024-08-17T02:26:46.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.224+0000 7fe4f6000640 1 -- 172.21.15.146:0/168921532 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe4ec0535e0 con 0x7fe5001401b0 2024-08-17T02:26:46.225 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.226+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 msgr2=0x7fe4e00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.226+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 0x7fe4e00676d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0034000 tx=0x7fe4f0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.226+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 msgr2=0x7fe5000a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.226+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00c590 tx=0x7fe4ec007d60 comp rx=0 tx=0).stop 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 shutdown_connections 2024-08-17T02:26:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e0065220 0x7fe4e00676d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5001401b0 0x7fe5000a5dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe500140580 0x7fe5000a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 --2- 172.21.15.146:0/168921532 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5000b1440 0x7fe5001676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 >> 172.21.15.146:0/168921532 conn(0x7fe5000cb9b0 msgr2=0x7fe5000c0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 shutdown_connections 2024-08-17T02:26:46.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.227+0000 7fe505800640 1 -- 172.21.15.146:0/168921532 wait complete. 2024-08-17T02:26:46.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:26:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.398+0000 7f1ba5a00640 1 Processor -- start 2024-08-17T02:26:46.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.398+0000 7f1ba5a00640 1 -- start start 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba00681c0 0x7f1ba006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 0x7f1ba0158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 0x7f1ba0159280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00a9350 con 0x7f1ba00681c0 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00a9630 con 0x7f1ba006e950 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1ba5a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00a9910 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.399+0000 7f1b9fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba00681c0 0x7f1ba006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba00681c0 0x7f1ba006e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47446/0 (socket says 172.21.15.146:47446) 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 -- 172.21.15.146:0/1333279194 learned_addr learned my addr 172.21.15.146:0/1333279194 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9f400640 1 --2- 172.21.15.146:0/1333279194 >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 0x7f1ba0158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1ba5000640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 0x7f1ba0159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 -- 172.21.15.146:0/1333279194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 msgr2=0x7f1ba0159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 0x7f1ba0159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 -- 172.21.15.146:0/1333279194 >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 msgr2=0x7f1ba0158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/1333279194 >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 0x7f1ba0158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9fe00640 1 -- 172.21.15.146:0/1333279194 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00a9bf0 con 0x7f1ba00681c0 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1ba5000640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 0x7f1ba0159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:46.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.400+0000 7f1b9f400640 1 --2- 172.21.15.146:0/1333279194 >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 0x7f1ba0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.401+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00681c0 0x7f1ba006e410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0076e00 tx=0x7f1b9000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d8bd13816956f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.401+0000 7f1b9ea00640 1 -- 172.21.15.146:0/1333279194 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90032640 con 0x7f1ba00681c0 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.401+0000 7f1b9ea00640 1 -- 172.21.15.146:0/1333279194 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900327a0 con 0x7f1ba00681c0 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.401+0000 7f1b9ea00640 1 -- 172.21.15.146:0/1333279194 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90032b80 con 0x7f1ba00681c0 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 -- 172.21.15.146:0/1333279194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00681c0 msgr2=0x7f1ba006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00681c0 0x7f1ba006e410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0076e00 tx=0x7f1b9000b460 comp rx=0 tx=0).stop 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 -- 172.21.15.146:0/1333279194 shutdown_connections 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba00aa3f0 0x7f1ba0159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/1333279194 >> v2:172.21.15.150:3300/0 conn(0x7f1ba006e950 0x7f1ba0158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/1333279194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00681c0 0x7f1ba006e410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 -- 172.21.15.146:0/1333279194 >> 172.21.15.146:0/1333279194 conn(0x7f1ba00cc040 msgr2=0x7f1ba00cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 -- 172.21.15.146:0/1333279194 shutdown_connections 2024-08-17T02:26:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.402+0000 7f1ba5a00640 1 -- 172.21.15.146:0/1333279194 wait complete. 2024-08-17T02:26:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.404+0000 7f1ba5a00640 1 Processor -- start 2024-08-17T02:26:46.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.404+0000 7f1ba5a00640 1 -- start start 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba00681c0 0x7f1ba00980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba006e950 0x7f1ba0098630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0099850 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00c7e50 con 0x7f1ba00681c0 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0098c40 con 0x7f1ba006e950 2024-08-17T02:26:46.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47458/0 (socket says 172.21.15.146:47458) 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 -- 172.21.15.146:0/815678077 learned_addr learned my addr 172.21.15.146:0/815678077 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1b9f400640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba006e950 0x7f1ba0098630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba00681c0 0x7f1ba00980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 -- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba006e950 msgr2=0x7f1ba0098630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba006e950 0x7f1ba0098630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 -- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba00681c0 msgr2=0x7f1ba00980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba00681c0 0x7f1ba00980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.405+0000 7f1ba5000640 1 -- 172.21.15.146:0/815678077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9000b700 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1ba5000640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007f30 tx=0x7f1b98009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800de20 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800f040 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98015690 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba0098f20 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.406+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba00994e0 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.407+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba0169f80 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.408+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b9801e3b0 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.409+0000 7f1b97400640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 0x7f1b80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.409+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1b980825d0 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.409+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 0x7f1b80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.410+0000 7f1b9fe00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 0x7f1b80067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b90037000 tx=0x7f1b9003a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.413+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1ba0169f80 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.649+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1ba0169f80 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.650+0000 7f1b97400640 1 -- 172.21.15.146:0/815678077 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1ba0169f80 con 0x7f1ba00aa3f0 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmd/MjDhAA243KnyfIesDCnXDxLZ4wnA==", 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.651 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmlLD8IBAARk12Zdk+4HlcMqMyzgU7qw==", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.652 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmx++EFxAAqRt2Z/TOm0hrkj3weqL/7w==", 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.653 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmlFRsKhAAoa6ZDgy8G3/DCHBtIYNCYQ==", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQACCsBm5SQiBBAAn5fQZ+qHHSDge+zlEQhPsQ==", 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.654 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAFCsBmM+62ChAAYsX3TsQRKfSyr1zQrI9Gzg==", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.655 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAICsBmikwMEBAAmCOC/tnXKO3vLcb4OGBOlA==", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQALCsBmCwXlGRAAaoC9oGhuYnf3NX7NwI6+MA==", 2024-08-17T02:26:46.656 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQARCsBmaFIAEhAAXV5jMiPCN7CDGDECz8ePvA==", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.657 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAUCsBm19FjFhAAPCkm2TYLgwYJnX1wb5GmTA==", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAXCsBmkgs1GhAAnbgfWEBAF+17T58NDwL/tQ==", 2024-08-17T02:26:46.658 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAaCsBmOsXYHhAAYfd/Ef3sOrc/AyKnUPWbWQ==", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.659 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmrj+TMhAAvkqX34FFpXyCVqCUadfe3A==", 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.660 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD/CcBmlYEvAxAAbB18skMrXknjPjp9N368yQ==", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmMb+kOBAAqzd63JzfgnwKvLA/pQjl2w==", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.661 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD/CcBmhGRSCRAAjt/c+ve2ZdexuMPt1Mj8vw==", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-08-17T02:26:46.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD9CcBmJRARGxAAb1PXnE+kfQgyko6rcqx5gA==", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:26:46.663 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBmjppzMxAA2VKIHeSTsUrbxBQ6H9DnCg==", 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBmJqRzMxAAlVb6CpjJ42F/TkKo5VeGvg==", 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.664 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBmXKxzMxAAmf8aGxhkGob3mucCcN3e6w==", 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBmyLVzMxAAcF37WnQ41RWz1zoPhJh6KQ==", 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.665 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBm7L5zMxAAZRWeB/UBeYT3W9UXMRAo6A==", 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAhCsBmjcdzMxAAFnqIFsAe7OSnUkRA4FQsgQ==", 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:26:46.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmC8zdBxAAJ3UyU3U4vm96pLKr79h4/w==", 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-08-17T02:26:46.667 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD+CcBmSecpARAAacTj/3UdJA7q44dV1f0Ueg==", 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-08-17T02:26:46.668 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:26:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 msgr2=0x7f1b80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 0x7f1b80067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b90037000 tx=0x7f1b9003a000 comp rx=0 tx=0).stop 2024-08-17T02:26:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 msgr2=0x7f1ba01542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b98007f30 tx=0x7f1b98009930 comp rx=0 tx=0).stop 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 shutdown_connections 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b80065150 0x7f1b80067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba00aa3f0 0x7f1ba01542e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ba006e950 0x7f1ba0098630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 --2- 172.21.15.146:0/815678077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ba00681c0 0x7f1ba00980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 >> 172.21.15.146:0/815678077 conn(0x7f1ba00cc040 msgr2=0x7f1ba00c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 shutdown_connections 2024-08-17T02:26:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.652+0000 7f1ba5a00640 1 -- 172.21.15.146:0/815678077 wait complete. 2024-08-17T02:26:46.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:26:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.819+0000 7f4616c00640 1 Processor -- start 2024-08-17T02:26:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.820+0000 7f4616c00640 1 -- start start 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4616c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f461006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4616c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46100cbea0 0x7f46100aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4616c00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100cc2b0 con 0x7f461015d4b0 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4616c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46100aa0d0 con 0x7f46100cbea0 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4616c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100cc4f0 con 0x7f461006d7a0 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4614e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46100cbea0 0x7f46100aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4614e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46100cbea0 0x7f46100aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47462/0 (socket says 172.21.15.146:47462) 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.821+0000 7f4614e00640 1 -- 172.21.15.146:0/4036753546 learned_addr learned my addr 172.21.15.146:0/4036753546 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.822+0000 7f4615800640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f461006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.822+0000 7f4614e00640 1 -- 172.21.15.146:0/4036753546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 msgr2=0x7f461006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.822+0000 7f4614e00640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f461006db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.822+0000 7f4614e00640 1 -- 172.21.15.146:0/4036753546 >> v1:172.21.15.150:6789/0 conn(0x7f461015d4b0 legacy=0x7f46101588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.822+0000 7f4614e00640 1 -- 172.21.15.146:0/4036753546 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100a9a80 con 0x7f46100cbea0 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.823+0000 7f4614e00640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f46100aa560 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009910 tx=0x7f45fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c14d200e57cee66 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.823+0000 7f460fe00640 1 -- 172.21.15.146:0/4036753546 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc032440 con 0x7f46100cbea0 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.823+0000 7f460fe00640 1 -- 172.21.15.146:0/4036753546 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc0325a0 con 0x7f46100cbea0 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.823+0000 7f460fe00640 1 -- 172.21.15.146:0/4036753546 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc032980 con 0x7f46100cbea0 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 -- 172.21.15.146:0/4036753546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 msgr2=0x7f46100aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f46100aa560 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009910 tx=0x7f45fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 -- 172.21.15.146:0/4036753546 shutdown_connections 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f46100aa560 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 --2- 172.21.15.146:0/4036753546 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f461006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 -- 172.21.15.146:0/4036753546 >> 172.21.15.146:0/4036753546 conn(0x7f4610067750 msgr2=0x7f46100cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 -- 172.21.15.146:0/4036753546 shutdown_connections 2024-08-17T02:26:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.824+0000 7f4616c00640 1 -- 172.21.15.146:0/4036753546 wait complete. 2024-08-17T02:26:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.825+0000 7f4616c00640 1 Processor -- start 2024-08-17T02:26:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.825+0000 7f4616c00640 1 -- start start 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f4610152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 0x7f4610156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461015b2a0 con 0x7f46100cbea0 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461015b580 con 0x7f461015d4b0 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4616c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461015b860 con 0x7f461006d7a0 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.826+0000 7f4614e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47464/0 (socket says 172.21.15.146:47464) 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 -- 172.21.15.146:0/1330569156 learned_addr learned my addr 172.21.15.146:0/1330569156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4615800640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f4610152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4616200640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 0x7f4610156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 -- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 msgr2=0x7f4610152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f4610152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 -- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 msgr2=0x7f4610156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 0x7f4610156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 -- 172.21.15.146:0/1330569156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009450 con 0x7f46100cbea0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4616200640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 0x7f4610156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f4614e00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f45fc035040 tx=0x7f45fc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.827+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc031a60 con 0x7f46100cbea0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.828+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc031c00 con 0x7f46100cbea0 2024-08-17T02:26:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.828+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc03d440 con 0x7f46100cbea0 2024-08-17T02:26:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.828+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461015bb40 con 0x7f46100cbea0 2024-08-17T02:26:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.828+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4610152660 con 0x7f46100cbea0 2024-08-17T02:26:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.829+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46101528a0 con 0x7f46100cbea0 2024-08-17T02:26:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.829+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45fc039040 con 0x7f46100cbea0 2024-08-17T02:26:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.830+0000 7f460cc00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 0x7f45f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.830+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f45fc0a1df0 con 0x7f46100cbea0 2024-08-17T02:26:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.830+0000 7f4615800640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 0x7f45f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.831+0000 7f4615800640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 0x7f45f0067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4604007ba0 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:46.834+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46101528a0 con 0x7f46100cbea0 2024-08-17T02:26:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.069+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f46101528a0 con 0x7f46100cbea0 2024-08-17T02:26:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.073+0000 7f460cc00640 1 -- 172.21.15.146:0/1330569156 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f46101528a0 con 0x7f46100cbea0 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.075+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 msgr2=0x7f45f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.075+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 0x7f45f0067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4604007ba0 tx=0x7f4604008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.075+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 msgr2=0x7f4610156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.075+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f45fc035040 tx=0x7f45fc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 shutdown_connections 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45f0065150 0x7f45f0067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46100cbea0 0x7f4610156420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f461015d4b0 0x7f4610156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 --2- 172.21.15.146:0/1330569156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f461006d7a0 0x7f4610152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 >> 172.21.15.146:0/1330569156 conn(0x7f4610067750 msgr2=0x7f4610152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 shutdown_connections 2024-08-17T02:26:47.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.076+0000 7f4616c00640 1 -- 172.21.15.146:0/1330569156 wait complete. 2024-08-17T02:26:47.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:26:47.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.245+0000 7f904be00640 1 Processor -- start 2024-08-17T02:26:47.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.245+0000 7f904be00640 1 -- start start 2024-08-17T02:26:47.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f904c0ac3e0 0x7f904c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904be00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0af5c0 con 0x7f904c0b0950 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904be00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0af810 con 0x7f904c155620 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904be00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0afaf0 con 0x7f904c0ac3e0 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f904c0ac3e0 0x7f904c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f904c0ac3e0 0x7f904c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47470/0 (socket says 172.21.15.146:47470) 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904b400640 1 -- 172.21.15.146:0/1913557822 learned_addr learned my addr 172.21.15.146:0/1913557822 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:47.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.246+0000 7f904a000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f904c0b0950 0x7f904c0abcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36274/0 (socket says 172.21.15.146:36274) 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.247+0000 7f904b400640 1 -- 172.21.15.146:0/1913557822 >> v1:172.21.15.150:6789/0 conn(0x7f904c155620 legacy=0x7f904c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.247+0000 7f904b400640 1 -- 172.21.15.146:0/1913557822 >> v1:172.21.15.146:6789/0 conn(0x7f904c0b0950 legacy=0x7f904c0abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.247+0000 7f904b400640 1 -- 172.21.15.146:0/1913557822 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0afdd0 con 0x7f904c0ac3e0 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.247+0000 7f9049600640 1 -- 172.21.15.146:0/1913557822 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144389189 0 0) 0x7f904c0af5c0 con 0x7f904c0b0950 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f904b400640 1 --2- 172.21.15.146:0/1913557822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0ac3e0 0x7f904c1559f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9044009f20 tx=0x7f9044009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f355fe9ad828b58b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f9049600640 1 -- 172.21.15.146:0/1913557822 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044031400 con 0x7f904c0ac3e0 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f9049600640 1 -- 172.21.15.146:0/1913557822 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904402d050 con 0x7f904c0ac3e0 2024-08-17T02:26:47.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f9049600640 1 -- 172.21.15.146:0/1913557822 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044031790 con 0x7f904c0ac3e0 2024-08-17T02:26:47.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f904be00640 1 -- 172.21.15.146:0/1913557822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0ac3e0 msgr2=0x7f904c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.248+0000 7f904be00640 1 --2- 172.21.15.146:0/1913557822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0ac3e0 0x7f904c1559f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9044009f20 tx=0x7f9044009840 comp rx=0 tx=0).stop 2024-08-17T02:26:47.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.249+0000 7f904be00640 1 -- 172.21.15.146:0/1913557822 shutdown_connections 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.249+0000 7f904be00640 1 --2- 172.21.15.146:0/1913557822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0ac3e0 0x7f904c1559f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.249+0000 7f904be00640 1 -- 172.21.15.146:0/1913557822 >> 172.21.15.146:0/1913557822 conn(0x7f904c0b0d70 msgr2=0x7f904c0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.249+0000 7f904be00640 1 -- 172.21.15.146:0/1913557822 shutdown_connections 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.249+0000 7f904be00640 1 -- 172.21.15.146:0/1913557822 wait complete. 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.250+0000 7f904be00640 1 Processor -- start 2024-08-17T02:26:47.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.250+0000 7f904be00640 1 -- start start 2024-08-17T02:26:47.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0ac3e0 0x7f904c166b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f904c155620 0x7f904c14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c14f430 con 0x7f904c0b0950 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c149540 con 0x7f904c0ac3e0 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c14c0a0 con 0x7f904c155620 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47486/0 (socket says 172.21.15.146:47486) 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904a000640 1 -- 172.21.15.146:0/2881705709 learned_addr learned my addr 172.21.15.146:0/2881705709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.251+0000 7f904aa00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0ac3e0 0x7f904c166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904b400640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f904c155620 0x7f904c14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 -- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f904c155620 msgr2=0x7f904c14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f904c155620 0x7f904c14e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 -- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0ac3e0 msgr2=0x7f904c166b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0ac3e0 0x7f904c166b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 -- 172.21.15.146:0/2881705709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044009ae0 con 0x7f904c0b0950 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904a000640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f903800c590 tx=0x7f9038007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9038007300 con 0x7f904c0b0950 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9038007480 con 0x7f904c0b0950 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.252+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c14c380 con 0x7f904c0b0950 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.253+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90380049f0 con 0x7f904c0b0950 2024-08-17T02:26:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.253+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c14c940 con 0x7f904c0b0950 2024-08-17T02:26:47.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.254+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c14cb60 con 0x7f904c0b0950 2024-08-17T02:26:47.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.254+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f903801c3b0 con 0x7f904c0b0950 2024-08-17T02:26:47.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.255+0000 7f9042000640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 0x7f902c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.255+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f90380814d0 con 0x7f904c0b0950 2024-08-17T02:26:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.255+0000 7f904aa00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 0x7f902c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.256+0000 7f904aa00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 0x7f902c067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f904c14be80 tx=0x7f903c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.259+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f903804fa10 con 0x7f904c0b0950 2024-08-17T02:26:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.495+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f904c071050 con 0x7f904c0b0950 2024-08-17T02:26:47.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.499+0000 7f9042000640 1 -- 172.21.15.146:0/2881705709 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9038053030 con 0x7f904c0b0950 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 msgr2=0x7f902c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 0x7f902c067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f904c14be80 tx=0x7f903c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 msgr2=0x7f904c148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f903800c590 tx=0x7f9038007cd0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 shutdown_connections 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f902c065150 0x7f902c067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904c0b0950 0x7f904c148970 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f904c155620 0x7f904c14e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.501+0000 7f904be00640 1 --2- 172.21.15.146:0/2881705709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f904c0ac3e0 0x7f904c166b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.502+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 >> 172.21.15.146:0/2881705709 conn(0x7f904c0b0d70 msgr2=0x7f904c154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.502+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 shutdown_connections 2024-08-17T02:26:47.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.502+0000 7f904be00640 1 -- 172.21.15.146:0/2881705709 wait complete. 2024-08-17T02:26:47.518 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:26:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.667+0000 7fe05c400640 1 Processor -- start 2024-08-17T02:26:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.667+0000 7fe05c400640 1 -- start start 2024-08-17T02:26:47.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.668+0000 7fe05c400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 0x7fe0540b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.668+0000 7fe05c400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe05415cb30 0x7fe0540b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.668+0000 7fe05c400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540b18d0 con 0x7fe054159130 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.668+0000 7fe05c400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540b0d00 con 0x7fe05415cb30 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.668+0000 7fe05c400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540b0fa0 con 0x7fe054158d60 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe05415cb30 0x7fe0540b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe05415cb30 0x7fe0540b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47488/0 (socket says 172.21.15.146:47488) 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 -- 172.21.15.146:0/3809645329 learned_addr learned my addr 172.21.15.146:0/3809645329 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059a00640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 0x7fe0540b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 -- 172.21.15.146:0/3809645329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 msgr2=0x7fe0540b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 0x7fe0540b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 -- 172.21.15.146:0/3809645329 >> v1:172.21.15.150:6789/0 conn(0x7fe054159130 legacy=0x7fe0540c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059000640 1 -- 172.21.15.146:0/3809645329 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540b1280 con 0x7fe05415cb30 2024-08-17T02:26:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.669+0000 7fe059a00640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 0x7fe0540b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.670+0000 7fe059000640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05415cb30 0x7fe0540b22a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe040009910 tx=0x7fe0400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7677d7039405cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe053e00640 1 -- 172.21.15.146:0/3809645329 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04002adb0 con 0x7fe05415cb30 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe053e00640 1 -- 172.21.15.146:0/3809645329 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe040032440 con 0x7fe05415cb30 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe053e00640 1 -- 172.21.15.146:0/3809645329 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040032820 con 0x7fe05415cb30 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 -- 172.21.15.146:0/3809645329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05415cb30 msgr2=0x7fe0540b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05415cb30 0x7fe0540b22a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe040009910 tx=0x7fe0400091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 -- 172.21.15.146:0/3809645329 shutdown_connections 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05415cb30 0x7fe0540b22a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 --2- 172.21.15.146:0/3809645329 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe054158d60 0x7fe0540b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 -- 172.21.15.146:0/3809645329 >> 172.21.15.146:0/3809645329 conn(0x7fe0540b3040 msgr2=0x7fe0540b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 -- 172.21.15.146:0/3809645329 shutdown_connections 2024-08-17T02:26:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.671+0000 7fe05c400640 1 -- 172.21.15.146:0/3809645329 wait complete. 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.673+0000 7fe05c400640 1 Processor -- start 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.673+0000 7fe05c400640 1 -- start start 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159130 0x7fe0541555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 0x7fe05415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415f090 con 0x7fe054158d60 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415e480 con 0x7fe054159130 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05c400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05415e760 con 0x7fe05415cb30 2024-08-17T02:26:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47502/0 (socket says 172.21.15.146:47502) 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 -- 172.21.15.146:0/2005252659 learned_addr learned my addr 172.21.15.146:0/2005252659 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059000640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159130 0x7fe0541555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05a400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 0x7fe05415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 -- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 msgr2=0x7fe05415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 0x7fe05415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 -- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159130 msgr2=0x7fe0541555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159130 0x7fe0541555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe059a00640 1 -- 172.21.15.146:0/2005252659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040009450 con 0x7fe054158d60 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.674+0000 7fe05a400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 0x7fe05415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe059a00640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c880 tx=0x7fe048008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800ce10 con 0x7fe054158d60 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048007920 con 0x7fe054158d60 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05415ea40 con 0x7fe054158d60 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048007ca0 con 0x7fe054158d60 2024-08-17T02:26:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.675+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe054155af0 con 0x7fe054158d60 2024-08-17T02:26:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.676+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05415eec0 con 0x7fe054158d60 2024-08-17T02:26:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.677+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe048011600 con 0x7fe054158d60 2024-08-17T02:26:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.677+0000 7fe050c00640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 0x7fe034067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.678+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe048082150 con 0x7fe054158d60 2024-08-17T02:26:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.678+0000 7fe059000640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 0x7fe034067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.679+0000 7fe059000640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 0x7fe034067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe040034000 tx=0x7fe040032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:47.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.682+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe048053ff0 con 0x7fe054158d60 2024-08-17T02:26:47.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.921+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe054064db0 con 0x7fe054158d60 2024-08-17T02:26:47.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.925+0000 7fe050c00640 1 -- 172.21.15.146:0/2005252659 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe048053b80 con 0x7fe054158d60 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 msgr2=0x7fe034067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 0x7fe034067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe040034000 tx=0x7fe040032000 comp rx=0 tx=0).stop 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 msgr2=0x7fe054098440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c880 tx=0x7fe048008040 comp rx=0 tx=0).stop 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 shutdown_connections 2024-08-17T02:26:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe034065150 0x7fe034067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe05415cb30 0x7fe05415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe054159130 0x7fe0541555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 --2- 172.21.15.146:0/2005252659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe054158d60 0x7fe054098440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.927+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 >> 172.21.15.146:0/2005252659 conn(0x7fe0540b3040 msgr2=0x7fe0541595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.928+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 shutdown_connections 2024-08-17T02:26:47.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:47.928+0000 7fe05c400640 1 -- 172.21.15.146:0/2005252659 wait complete. 2024-08-17T02:26:47.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:26:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.093+0000 7ff211e00640 1 Processor -- start 2024-08-17T02:26:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.093+0000 7ff211e00640 1 -- start start 2024-08-17T02:26:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.094+0000 7ff211e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff20c155180 0x7ff20c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.094+0000 7ff211e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0afc10 con 0x7ff20c06e080 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.094+0000 7ff211e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20c0af000 con 0x7ff20c155550 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.094+0000 7ff211e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff20c0af2e0 con 0x7ff20c155180 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff20c155180 0x7ff20c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff20c06e080 0x7ff20c06e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36288/0 (socket says 172.21.15.146:36288) 2024-08-17T02:26:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20b400640 1 -- 172.21.15.146:0/3135913757 learned_addr learned my addr 172.21.15.146:0/3135913757 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20aa00640 1 -- 172.21.15.146:0/3135913757 >> v1:172.21.15.150:6789/0 conn(0x7ff20c155550 legacy=0x7ff20c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff209600640 1 -- 172.21.15.146:0/3135913757 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827925952 0 0) 0x7ff20c0afc10 con 0x7ff20c06e080 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20aa00640 1 -- 172.21.15.146:0/3135913757 >> v1:172.21.15.146:6789/0 conn(0x7ff20c06e080 legacy=0x7ff20c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.095+0000 7ff20aa00640 1 -- 172.21.15.146:0/3135913757 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0af5c0 con 0x7ff20c155180 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.096+0000 7ff20aa00640 1 --2- 172.21.15.146:0/3135913757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c155180 0x7ff20c0aea20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d27a2d035db6a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.096+0000 7ff209600640 1 -- 172.21.15.146:0/3135913757 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc02ae20 con 0x7ff20c155180 2024-08-17T02:26:48.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.096+0000 7ff209600640 1 -- 172.21.15.146:0/3135913757 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc032440 con 0x7ff20c155180 2024-08-17T02:26:48.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.096+0000 7ff209600640 1 -- 172.21.15.146:0/3135913757 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0327e0 con 0x7ff20c155180 2024-08-17T02:26:48.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 -- 172.21.15.146:0/3135913757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c155180 msgr2=0x7ff20c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 --2- 172.21.15.146:0/3135913757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c155180 0x7ff20c0aea20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 -- 172.21.15.146:0/3135913757 shutdown_connections 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 --2- 172.21.15.146:0/3135913757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c155180 0x7ff20c0aea20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 -- 172.21.15.146:0/3135913757 >> 172.21.15.146:0/3135913757 conn(0x7ff20c0cb9b0 msgr2=0x7ff20c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 -- 172.21.15.146:0/3135913757 shutdown_connections 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.097+0000 7ff211e00640 1 -- 172.21.15.146:0/3135913757 wait complete. 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.098+0000 7ff211e00640 1 Processor -- start 2024-08-17T02:26:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 -- start start 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20c155180 0x7ff20c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff20c155550 0x7ff20c0abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c157f70 con 0x7ff20c06e080 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c1573a0 con 0x7ff20c155550 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.099+0000 7ff211e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20c157640 con 0x7ff20c155180 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47524/0 (socket says 172.21.15.146:47524) 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 -- 172.21.15.146:0/4184667362 learned_addr learned my addr 172.21.15.146:0/4184667362 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 -- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20c155180 msgr2=0x7ff20c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20c155180 0x7ff20c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 -- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff20c155550 msgr2=0x7ff20c0abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff20c155550 0x7ff20c0abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 -- 172.21.15.146:0/4184667362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009390 con 0x7ff20c06e080 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.100+0000 7ff20aa00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.101+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc031b30 con 0x7ff20c06e080 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.101+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc031cb0 con 0x7ff20c06e080 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.101+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20c157920 con 0x7ff20c06e080 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.101+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc03d690 con 0x7ff20c06e080 2024-08-17T02:26:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.101+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20c153700 con 0x7ff20c06e080 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.102+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20c064db0 con 0x7ff20c06e080 2024-08-17T02:26:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.102+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff1fc039040 con 0x7ff20c06e080 2024-08-17T02:26:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.104+0000 7ff202000640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.104+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff1fc0a2100 con 0x7ff20c06e080 2024-08-17T02:26:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.104+0000 7ff20a000640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.105+0000 7ff20a000640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 0x7ff1ec067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0ab930 tx=0x7ff1f8007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.108+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff1fc070470 con 0x7ff20c06e080 2024-08-17T02:26:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.344+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff20c070740 con 0x7ff20c06e080 2024-08-17T02:26:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.348+0000 7ff202000640 1 -- 172.21.15.146:0/4184667362 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff1fc073a90 con 0x7ff20c06e080 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 msgr2=0x7ff1ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 0x7ff1ec067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0ab930 tx=0x7ff1f8007ab0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 msgr2=0x7ff20c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009850 tx=0x7ff1fc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 shutdown_connections 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff20c155550 0x7ff20c0abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff20c155180 0x7ff20c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 --2- 172.21.15.146:0/4184667362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff20c06e080 0x7ff20c1531c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 >> 172.21.15.146:0/4184667362 conn(0x7ff20c0cb9b0 msgr2=0x7ff20c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 shutdown_connections 2024-08-17T02:26:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.351+0000 7ff211e00640 1 -- 172.21.15.146:0/4184667362 wait complete. 2024-08-17T02:26:48.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:26:48.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.516+0000 7f0ae4200640 1 Processor -- start 2024-08-17T02:26:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.516+0000 7f0ae4200640 1 -- start start 2024-08-17T02:26:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae4200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae4200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0adc140580 0x7f0adc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae4200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc0caa80 con 0x7f0adc1401b0 2024-08-17T02:26:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae4200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0cb450 con 0x7f0adc140580 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae4200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c9e70 con 0x7f0adc0b1440 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0adc140580 0x7f0adc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0adc140580 0x7f0adc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47536/0 (socket says 172.21.15.146:47536) 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 -- 172.21.15.146:0/2783784864 learned_addr learned my addr 172.21.15.146:0/2783784864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae1800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0adc1401b0 0x7f0adc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36296/0 (socket says 172.21.15.146:36296) 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae0e00640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 -- 172.21.15.146:0/2783784864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 msgr2=0x7f0adc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 -- 172.21.15.146:0/2783784864 >> v1:172.21.15.146:6789/0 conn(0x7f0adc1401b0 legacy=0x7f0adc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.518+0000 7f0ae2200640 1 -- 172.21.15.146:0/2783784864 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0ca150 con 0x7f0adc140580 2024-08-17T02:26:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.519+0000 7f0ae2200640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc140580 0x7f0adc0c9040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009f20 tx=0x7f0ad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7df32295d32864b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0adbe00640 1 -- 172.21.15.146:0/2783784864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4031400 con 0x7f0adc140580 2024-08-17T02:26:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0adbe00640 1 -- 172.21.15.146:0/2783784864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad402d050 con 0x7f0adc140580 2024-08-17T02:26:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0adbe00640 1 -- 172.21.15.146:0/2783784864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40317d0 con 0x7f0adc140580 2024-08-17T02:26:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 -- 172.21.15.146:0/2783784864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc140580 msgr2=0x7f0adc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc140580 0x7f0adc0c9040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009f20 tx=0x7f0ad4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 -- 172.21.15.146:0/2783784864 shutdown_connections 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc140580 0x7f0adc0c9040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 --2- 172.21.15.146:0/2783784864 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 -- 172.21.15.146:0/2783784864 >> 172.21.15.146:0/2783784864 conn(0x7f0adc0cb9b0 msgr2=0x7f0adc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 -- 172.21.15.146:0/2783784864 shutdown_connections 2024-08-17T02:26:48.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.520+0000 7f0ae4200640 1 -- 172.21.15.146:0/2783784864 wait complete. 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.522+0000 7f0ae4200640 1 Processor -- start 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.522+0000 7f0ae4200640 1 -- start start 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 0x7f0adc06d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc16c8c0 con 0x7f0adc1401b0 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0c80d0 con 0x7f0adc140580 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae4200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc16cb60 con 0x7f0adc0b1440 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47550/0 (socket says 172.21.15.146:47550) 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 -- 172.21.15.146:0/3903182076 learned_addr learned my addr 172.21.15.146:0/3903182076 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae1800640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae2200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 0x7f0adc06d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 -- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 msgr2=0x7f0adc0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 -- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 msgr2=0x7f0adc06d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 0x7f0adc06d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae0e00640 1 -- 172.21.15.146:0/3903182076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009ae0 con 0x7f0adc1401b0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.523+0000 7f0ae2200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 0x7f0adc06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ae0e00640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800d890 tx=0x7f0ac8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800de20 con 0x7f0adc1401b0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80098b0 con 0x7f0adc1401b0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc16ce40 con 0x7f0adc1401b0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8009c50 con 0x7f0adc1401b0 2024-08-17T02:26:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.524+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc16d400 con 0x7f0adc1401b0 2024-08-17T02:26:48.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.525+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc064db0 con 0x7f0adc1401b0 2024-08-17T02:26:48.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.526+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0ac8014620 con 0x7f0adc1401b0 2024-08-17T02:26:48.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.527+0000 7f0ad8c00640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 0x7f0abc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.527+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0ac80829e0 con 0x7f0adc1401b0 2024-08-17T02:26:48.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.527+0000 7f0ae1800640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 0x7f0abc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.527+0000 7f0ae1800640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 0x7f0abc067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007790 tx=0x7f0ad0007ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.531+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0ac8050d50 con 0x7f0adc1401b0 2024-08-17T02:26:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.765+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0adc0c8350 con 0x7f0adc1401b0 2024-08-17T02:26:48.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.769+0000 7f0ad8c00640 1 -- 172.21.15.146:0/3903182076 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ac8009db0 con 0x7f0adc1401b0 2024-08-17T02:26:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 msgr2=0x7f0abc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 0x7f0abc067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0007790 tx=0x7f0ad0007ce0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 msgr2=0x7f0adc15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800d890 tx=0x7f0ac8008040 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 shutdown_connections 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0abc065150 0x7f0abc067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0adc1401b0 0x7f0adc15a4e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0adc140580 0x7f0adc06d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 --2- 172.21.15.146:0/3903182076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0adc0b1440 0x7f0adc0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 >> 172.21.15.146:0/3903182076 conn(0x7f0adc0cb9b0 msgr2=0x7f0adc0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 shutdown_connections 2024-08-17T02:26:48.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.772+0000 7f0ae4200640 1 -- 172.21.15.146:0/3903182076 wait complete. 2024-08-17T02:26:48.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:26:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.937+0000 7f2b91600640 1 Processor -- start 2024-08-17T02:26:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.938+0000 7f2b91600640 1 -- start start 2024-08-17T02:26:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b91600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b8c0b0270 0x7f2b8c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b91600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c157690 con 0x7f2b8c155900 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b91600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c156a80 con 0x7f2b8c158b30 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b91600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c156d60 con 0x7f2b8c0b0270 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b83400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b8c0b0270 0x7f2b8c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b83400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b8c0b0270 0x7f2b8c1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47552/0 (socket says 172.21.15.146:47552) 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b83400640 1 -- 172.21.15.146:0/728763248 learned_addr learned my addr 172.21.15.146:0/728763248 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.939+0000 7f2b8be00640 1 --1- 172.21.15.146:0/728763248 >> v1:172.21.15.146:6789/0 conn(0x7f2b8c155900 0x7f2b8c155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36300/0 (socket says 172.21.15.146:36300) 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.940+0000 7f2b83400640 1 -- 172.21.15.146:0/728763248 >> v1:172.21.15.150:6789/0 conn(0x7f2b8c158b30 legacy=0x7f2b8c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.940+0000 7f2b83400640 1 -- 172.21.15.146:0/728763248 >> v1:172.21.15.146:6789/0 conn(0x7f2b8c155900 legacy=0x7f2b8c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.940+0000 7f2b83400640 1 -- 172.21.15.146:0/728763248 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c157040 con 0x7f2b8c0b0270 2024-08-17T02:26:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.940+0000 7f2b8b400640 1 -- 172.21.15.146:0/728763248 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338814471 0 0) 0x7f2b8c157690 con 0x7f2b8c155900 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b83400640 1 --2- 172.21.15.146:0/728763248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1563e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009910 tx=0x7f2b740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ecece6bbb8129d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b8b400640 1 -- 172.21.15.146:0/728763248 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7402ae60 con 0x7f2b8c0b0270 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b8b400640 1 -- 172.21.15.146:0/728763248 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74032440 con 0x7f2b8c0b0270 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b8b400640 1 -- 172.21.15.146:0/728763248 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b740327e0 con 0x7f2b8c0b0270 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b91600640 1 -- 172.21.15.146:0/728763248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c0b0270 msgr2=0x7f2b8c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b91600640 1 --2- 172.21.15.146:0/728763248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1563e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009910 tx=0x7f2b740091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b91600640 1 -- 172.21.15.146:0/728763248 shutdown_connections 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b91600640 1 --2- 172.21.15.146:0/728763248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1563e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.941+0000 7f2b91600640 1 -- 172.21.15.146:0/728763248 >> 172.21.15.146:0/728763248 conn(0x7f2b8c067750 msgr2=0x7f2b8c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.942+0000 7f2b91600640 1 -- 172.21.15.146:0/728763248 shutdown_connections 2024-08-17T02:26:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.942+0000 7f2b91600640 1 -- 172.21.15.146:0/728763248 wait complete. 2024-08-17T02:26:48.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.943+0000 7f2b91600640 1 Processor -- start 2024-08-17T02:26:48.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.943+0000 7f2b91600640 1 -- start start 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 0x7f2b8c0a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c166f10 con 0x7f2b8c155900 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c167b30 con 0x7f2b8c0b0270 2024-08-17T02:26:48.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b91600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0a9240 con 0x7f2b8c158b30 2024-08-17T02:26:48.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b83400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b83400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47558/0 (socket says 172.21.15.146:47558) 2024-08-17T02:26:48.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b83400640 1 -- 172.21.15.146:0/114532997 learned_addr learned my addr 172.21.15.146:0/114532997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b83400640 1 -- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 msgr2=0x7f2b8c0a8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.944+0000 7f2b90c00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 0x7f2b8c0a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b8be00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83400640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 0x7f2b8c0a8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83400640 1 -- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 msgr2=0x7f2b8c1675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83400640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83400640 1 -- 172.21.15.146:0/114532997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74009450 con 0x7f2b8c155900 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b90c00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 0x7f2b8c0a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b8be00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83400640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b74035040 tx=0x7f2b74032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74031b30 con 0x7f2b8c155900 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74031cd0 con 0x7f2b8c155900 2024-08-17T02:26:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c0a9520 con 0x7f2b8c155900 2024-08-17T02:26:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7403b650 con 0x7f2b8c155900 2024-08-17T02:26:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.945+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c0a9ae0 con 0x7f2b8c155900 2024-08-17T02:26:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.946+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c071050 con 0x7f2b8c155900 2024-08-17T02:26:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.947+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b74043030 con 0x7f2b8c155900 2024-08-17T02:26:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.948+0000 7f2b83e00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.948+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2b74041070 con 0x7f2b8c155900 2024-08-17T02:26:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.948+0000 7f2b8be00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.949+0000 7f2b8be00640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c151c50 tx=0x7f2b7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:48.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:48.952+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b74070cb0 con 0x7f2b8c155900 2024-08-17T02:26:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.188+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2b8c06f480 con 0x7f2b8c155900 2024-08-17T02:26:49.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.192+0000 7f2b83e00640 1 -- 172.21.15.146:0/114532997 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2b740370a0 con 0x7f2b8c155900 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 msgr2=0x7f2b68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c151c50 tx=0x7f2b7c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 msgr2=0x7f2b8c0a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b74035040 tx=0x7f2b74032000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 shutdown_connections 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8c155900 0x7f2b8c0a8660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b8c158b30 0x7f2b8c0a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 --2- 172.21.15.146:0/114532997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b8c0b0270 0x7f2b8c1675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.194+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 >> 172.21.15.146:0/114532997 conn(0x7f2b8c067750 msgr2=0x7f2b8c0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.195+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 shutdown_connections 2024-08-17T02:26:49.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.195+0000 7f2b91600640 1 -- 172.21.15.146:0/114532997 wait complete. 2024-08-17T02:26:49.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 Processor -- start 2024-08-17T02:26:49.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 -- start start 2024-08-17T02:26:49.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b34158ce0 0x7f3b340c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b341590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b340cb7c0 con 0x7f3b340cac30 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b340cf0c0 con 0x7f3b34158ce0 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b3c200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34089000 con 0x7f3b340d08d0 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b39800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b34158ce0 0x7f3b340c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b39800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b34158ce0 0x7f3b340c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47574/0 (socket says 172.21.15.146:47574) 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.361+0000 7f3b39800640 1 -- 172.21.15.146:0/4214996500 learned_addr learned my addr 172.21.15.146:0/4214996500 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:49.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.362+0000 7f3b38e00640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b341590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.362+0000 7f3b39800640 1 -- 172.21.15.146:0/4214996500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 msgr2=0x7f3b341590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.362+0000 7f3b39800640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b341590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.362+0000 7f3b39800640 1 -- 172.21.15.146:0/4214996500 >> v1:172.21.15.150:6789/0 conn(0x7f3b340cac30 legacy=0x7f3b340cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.362+0000 7f3b39800640 1 -- 172.21.15.146:0/4214996500 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340ceb20 con 0x7f3b34158ce0 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.363+0000 7f3b39800640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b34158ce0 0x7f3b340c68c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009f50 tx=0x7f3b28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbaf4a6f93fa02d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.363+0000 7f3b33e00640 1 -- 172.21.15.146:0/4214996500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28033410 con 0x7f3b34158ce0 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.363+0000 7f3b33e00640 1 -- 172.21.15.146:0/4214996500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28033570 con 0x7f3b34158ce0 2024-08-17T02:26:49.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.363+0000 7f3b33e00640 1 -- 172.21.15.146:0/4214996500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28033950 con 0x7f3b34158ce0 2024-08-17T02:26:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 -- 172.21.15.146:0/4214996500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b34158ce0 msgr2=0x7f3b340c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b34158ce0 0x7f3b340c68c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009f50 tx=0x7f3b28009840 comp rx=0 tx=0).stop 2024-08-17T02:26:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 -- 172.21.15.146:0/4214996500 shutdown_connections 2024-08-17T02:26:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b341590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 --2- 172.21.15.146:0/4214996500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b34158ce0 0x7f3b340c68c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 -- 172.21.15.146:0/4214996500 >> 172.21.15.146:0/4214996500 conn(0x7f3b340cfdc0 msgr2=0x7f3b340d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 -- 172.21.15.146:0/4214996500 shutdown_connections 2024-08-17T02:26:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.364+0000 7f3b3c200640 1 -- 172.21.15.146:0/4214996500 wait complete. 2024-08-17T02:26:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.365+0000 7f3b3c200640 1 Processor -- start 2024-08-17T02:26:49.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.365+0000 7f3b3c200640 1 -- start start 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b34154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b34158ce0 0x7f3b340b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3409ab60 con 0x7f3b340cac30 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34154c80 con 0x7f3b34158ce0 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b3c200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34099f50 con 0x7f3b340d08d0 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b39800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b39800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47584/0 (socket says 172.21.15.146:47584) 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b39800640 1 -- 172.21.15.146:0/2885685918 learned_addr learned my addr 172.21.15.146:0/2885685918 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:49.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.366+0000 7f3b38e00640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b34154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b3a200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b34158ce0 0x7f3b340b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 -- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 msgr2=0x7f3b34154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b34154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 -- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b34158ce0 msgr2=0x7f3b340b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b34158ce0 0x7f3b340b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 -- 172.21.15.146:0/2885685918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009ae0 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b39800640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fb0 tx=0x7f3b28037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28007810 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28007990 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28007d50 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.367+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3409a230 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.368+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3409a7f0 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.369+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b34064db0 con 0x7f3b340cac30 2024-08-17T02:26:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.369+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3b2803e640 con 0x7f3b340cac30 2024-08-17T02:26:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.370+0000 7f3b30c00640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 0x7f3b14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.370+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3b280a3440 con 0x7f3b340cac30 2024-08-17T02:26:49.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.370+0000 7f3b38e00640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 0x7f3b14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.371+0000 7f3b38e00640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 0x7f3b14067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b3409dbc0 tx=0x7f3b20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.374+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3b28071860 con 0x7f3b340cac30 2024-08-17T02:26:49.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.547+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b341561c0 con 0x7f3b340cac30 2024-08-17T02:26:49.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.548+0000 7f3b30c00640 1 -- 172.21.15.146:0/2885685918 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f3b28074e80 con 0x7f3b340cac30 2024-08-17T02:26:49.549 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:49.549 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:46.230143+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 msgr2=0x7f3b14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 0x7f3b14067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b3409dbc0 tx=0x7f3b20008040 comp rx=0 tx=0).stop 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 msgr2=0x7f3b34099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fb0 tx=0x7f3b28037000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 shutdown_connections 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3b14065150 0x7f3b14067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b34158ce0 0x7f3b340b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b340d08d0 0x7f3b34154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 --2- 172.21.15.146:0/2885685918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b340cac30 0x7f3b34099970 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.550+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 >> 172.21.15.146:0/2885685918 conn(0x7f3b340cfdc0 msgr2=0x7f3b340c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.551+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 shutdown_connections 2024-08-17T02:26:49.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.551+0000 7f3b3c200640 1 -- 172.21.15.146:0/2885685918 wait complete. 2024-08-17T02:26:49.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:49.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 Processor -- start 2024-08-17T02:26:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 -- start start 2024-08-17T02:26:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79d40accf0 0x7f79d40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 0x7f79d4157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40ae540 con 0x7f79d4159610 2024-08-17T02:26:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d40ad930 con 0x7f79d40accf0 2024-08-17T02:26:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79da400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d40adc10 con 0x7f79d40afd90 2024-08-17T02:26:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79d2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f79d4159610 0x7f79d40af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36312/0 (socket says 172.21.15.146:36312) 2024-08-17T02:26:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.719+0000 7f79d2a00640 1 -- 172.21.15.146:0/3167993892 learned_addr learned my addr 172.21.15.146:0/3167993892 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3167993892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 0x7f79d4157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3400640 1 --2- 172.21.15.146:0/3167993892 >> v2:172.21.15.150:3300/0 conn(0x7f79d40accf0 0x7f79d40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d2000640 1 -- 172.21.15.146:0/3167993892 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196037793 0 0) 0x7f79d40ae540 con 0x7f79d4159610 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d2000640 1 -- 172.21.15.146:0/3167993892 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b80034e0 con 0x7f79d4159610 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3e00640 1 -- 172.21.15.146:0/3167993892 >> v2:172.21.15.150:3300/0 conn(0x7f79d40accf0 msgr2=0x7f79d40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3167993892 >> v2:172.21.15.150:3300/0 conn(0x7f79d40accf0 0x7f79d40b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3e00640 1 -- 172.21.15.146:0/3167993892 >> v1:172.21.15.146:6789/0 conn(0x7f79d4159610 legacy=0x7f79d40af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.720+0000 7f79d3e00640 1 -- 172.21.15.146:0/3167993892 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40adef0 con 0x7f79d40afd90 2024-08-17T02:26:49.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.721+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3167993892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 0x7f79d4157690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009e60 tx=0x7f79cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa29710a6513124 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79d2000640 1 -- 172.21.15.146:0/3167993892 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007550 con 0x7f79d40afd90 2024-08-17T02:26:49.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79d2000640 1 -- 172.21.15.146:0/3167993892 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc02d050 con 0x7f79d40afd90 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79d2000640 1 -- 172.21.15.146:0/3167993892 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007900 con 0x7f79d40afd90 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 -- 172.21.15.146:0/3167993892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 msgr2=0x7f79d4157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 --2- 172.21.15.146:0/3167993892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 0x7f79d4157690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009e60 tx=0x7f79cc009780 comp rx=0 tx=0).stop 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 -- 172.21.15.146:0/3167993892 shutdown_connections 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 --2- 172.21.15.146:0/3167993892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40afd90 0x7f79d4157690 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 --2- 172.21.15.146:0/3167993892 >> v2:172.21.15.150:3300/0 conn(0x7f79d40accf0 0x7f79d40b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 -- 172.21.15.146:0/3167993892 >> 172.21.15.146:0/3167993892 conn(0x7f79d4067750 msgr2=0x7f79d40cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 -- 172.21.15.146:0/3167993892 shutdown_connections 2024-08-17T02:26:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.722+0000 7f79da400640 1 -- 172.21.15.146:0/3167993892 wait complete. 2024-08-17T02:26:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.724+0000 7f79da400640 1 Processor -- start 2024-08-17T02:26:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.724+0000 7f79da400640 1 -- start start 2024-08-17T02:26:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40accf0 0x7f79d4149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40afd90 0x7f79d414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4153190 con 0x7f79d4159610 2024-08-17T02:26:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4152180 con 0x7f79d40afd90 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79da400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d416a1f0 con 0x7f79d40accf0 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79d3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47600/0 (socket says 172.21.15.146:47600) 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79d3e00640 1 -- 172.21.15.146:0/3547199763 learned_addr learned my addr 172.21.15.146:0/3547199763 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79d3400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40accf0 0x7f79d4149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.725+0000 7f79d2a00640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40afd90 0x7f79d414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 -- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40accf0 msgr2=0x7f79d4149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40accf0 0x7f79d4149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 -- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40afd90 msgr2=0x7f79d414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40afd90 0x7f79d414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 -- 172.21.15.146:0/3547199763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009a20 con 0x7f79d4159610 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79d3e00640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0097c0 tx=0x7f79cc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc031ac0 con 0x7f79d4159610 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc031c40 con 0x7f79d4159610 2024-08-17T02:26:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc03d430 con 0x7f79d4159610 2024-08-17T02:26:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d41523d0 con 0x7f79d4159610 2024-08-17T02:26:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.726+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d4152990 con 0x7f79d4159610 2024-08-17T02:26:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.727+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4064db0 con 0x7f79d4159610 2024-08-17T02:26:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.728+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f79cc003040 con 0x7f79d4159610 2024-08-17T02:26:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.729+0000 7f79caa00640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 0x7f79b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.729+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f79cc0a3ac0 con 0x7f79d4159610 2024-08-17T02:26:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.729+0000 7f79d3400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 0x7f79b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.730+0000 7f79d3400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 0x7f79b4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009d20 tx=0x7f79c40090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.733+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f79cc071ee0 con 0x7f79d4159610 2024-08-17T02:26:49.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.903+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79d40cc480 con 0x7f79d4159610 2024-08-17T02:26:49.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.903+0000 7f79caa00640 1 -- 172.21.15.146:0/3547199763 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79cc075500 con 0x7f79d4159610 2024-08-17T02:26:49.905 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.905+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 msgr2=0x7f79b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.905+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 0x7f79b4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009d20 tx=0x7f79c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.905+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 msgr2=0x7f79d414f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.905+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0097c0 tx=0x7f79cc037000 comp rx=0 tx=0).stop 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 shutdown_connections 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f79b4065150 0x7f79b4067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4159610 0x7f79d414f7a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79d40afd90 0x7f79d414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 --2- 172.21.15.146:0/3547199763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79d40accf0 0x7f79d4149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 >> 172.21.15.146:0/3547199763 conn(0x7f79d4067750 msgr2=0x7f79d4156970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 shutdown_connections 2024-08-17T02:26:49.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:49.906+0000 7f79da400640 1 -- 172.21.15.146:0/3547199763 wait complete. 2024-08-17T02:26:49.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:50.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.069+0000 7f446a000640 1 Processor -- start 2024-08-17T02:26:50.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.070+0000 7f446a000640 1 -- start start 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f446a000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44640afdd0 0x7f44641563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f446a000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4464157690 con 0x7f44640b0270 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f446a000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4464156a80 con 0x7f4464155900 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f446a000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4464156d60 con 0x7f44640afdd0 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f445be00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f44640b0270 0x7f44640ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36328/0 (socket says 172.21.15.146:36328) 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f445be00640 1 -- 172.21.15.146:0/2238976110 learned_addr learned my addr 172.21.15.146:0/2238976110 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.071+0000 7f4469600640 1 --2- 172.21.15.146:0/2238976110 >> v2:172.21.15.146:3300/0 conn(0x7f44640afdd0 0x7f44641563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.072+0000 7f4469600640 1 -- 172.21.15.146:0/2238976110 >> v1:172.21.15.150:6789/0 conn(0x7f4464155900 legacy=0x7f4464155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.072+0000 7f4469600640 1 -- 172.21.15.146:0/2238976110 >> v1:172.21.15.146:6789/0 conn(0x7f44640b0270 legacy=0x7f44640ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.072+0000 7f4469600640 1 -- 172.21.15.146:0/2238976110 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464157040 con 0x7f44640afdd0 2024-08-17T02:26:50.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.072+0000 7f4463e00640 1 -- 172.21.15.146:0/2238976110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895652295 0 0) 0x7f4464157690 con 0x7f44640b0270 2024-08-17T02:26:50.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f4469600640 1 --2- 172.21.15.146:0/2238976110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640afdd0 0x7f44641563e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f445c009e60 tx=0x7f445c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d894167867ac5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f4463e00640 1 -- 172.21.15.146:0/2238976110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c007550 con 0x7f44640afdd0 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f4463e00640 1 -- 172.21.15.146:0/2238976110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c02d050 con 0x7f44640afdd0 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f4463e00640 1 -- 172.21.15.146:0/2238976110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c0078e0 con 0x7f44640afdd0 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f446a000640 1 -- 172.21.15.146:0/2238976110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640afdd0 msgr2=0x7f44641563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f446a000640 1 --2- 172.21.15.146:0/2238976110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640afdd0 0x7f44641563e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f445c009e60 tx=0x7f445c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f446a000640 1 -- 172.21.15.146:0/2238976110 shutdown_connections 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f446a000640 1 --2- 172.21.15.146:0/2238976110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640afdd0 0x7f44641563e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.073+0000 7f446a000640 1 -- 172.21.15.146:0/2238976110 >> 172.21.15.146:0/2238976110 conn(0x7f4464067750 msgr2=0x7f44640cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.074+0000 7f446a000640 1 -- 172.21.15.146:0/2238976110 shutdown_connections 2024-08-17T02:26:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.074+0000 7f446a000640 1 -- 172.21.15.146:0/2238976110 wait complete. 2024-08-17T02:26:50.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.075+0000 7f446a000640 1 Processor -- start 2024-08-17T02:26:50.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.075+0000 7f446a000640 1 -- start start 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44640afdd0 0x7f4464169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 0x7f44640aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464154e70 con 0x7f44640b0270 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464169130 con 0x7f44640afdd0 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f446a000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4464169410 con 0x7f4464155900 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f445be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f445be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47618/0 (socket says 172.21.15.146:47618) 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f445be00640 1 -- 172.21.15.146:0/1394688246 learned_addr learned my addr 172.21.15.146:0/1394688246 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f4468c00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44640afdd0 0x7f4464169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.076+0000 7f4469600640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 0x7f44640aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 -- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 msgr2=0x7f44640aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 0x7f44640aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 -- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44640afdd0 msgr2=0x7f4464169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44640afdd0 0x7f4464169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 -- 172.21.15.146:0/1394688246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c009a20 con 0x7f44640b0270 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f4469600640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 0x7f44640aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f445be00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c5e0 tx=0x7f444c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c005aa0 con 0x7f44640b0270 2024-08-17T02:26:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c005c20 con 0x7f44640b0270 2024-08-17T02:26:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44641696f0 con 0x7f44640b0270 2024-08-17T02:26:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.077+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c007340 con 0x7f44640b0270 2024-08-17T02:26:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.078+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44641544a0 con 0x7f44640b0270 2024-08-17T02:26:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.079+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4464152e80 con 0x7f44640b0270 2024-08-17T02:26:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.079+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f444c01b400 con 0x7f44640b0270 2024-08-17T02:26:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.081+0000 7f4460c00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 0x7f4440067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.081+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f444c081ae0 con 0x7f44640b0270 2024-08-17T02:26:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.081+0000 7f4468c00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 0x7f4440067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.081+0000 7f4468c00640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 0x7f4440067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4454007fd0 tx=0x7f4454007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.085+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4464152e80 con 0x7f44640b0270 2024-08-17T02:26:50.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.262+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4464152e80 con 0x7f44640b0270 2024-08-17T02:26:50.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.264+0000 7f4460c00640 1 -- 172.21.15.146:0/1394688246 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4464152e80 con 0x7f44640b0270 2024-08-17T02:26:50.264 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:50.264 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-08-17T02:26:50.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:26:50.265 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-08-17T02:26:50.265 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-08-17T02:26:50.265 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:26:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 msgr2=0x7f4440067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 0x7f4440067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4454007fd0 tx=0x7f4454007e30 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 msgr2=0x7f4464154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c5e0 tx=0x7f444c007d00 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 shutdown_connections 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4440065150 0x7f4440067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44640b0270 0x7f4464154930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4464155900 0x7f44640aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 --2- 172.21.15.146:0/1394688246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44640afdd0 0x7f4464169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.265+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 >> 172.21.15.146:0/1394688246 conn(0x7f4464067750 msgr2=0x7f446406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.267+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 shutdown_connections 2024-08-17T02:26:50.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.267+0000 7f446a000640 1 -- 172.21.15.146:0/1394688246 wait complete. 2024-08-17T02:26:50.281 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:50.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:50.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.434+0000 7fe50e600640 1 Processor -- start 2024-08-17T02:26:50.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.434+0000 7fe50e600640 1 -- start start 2024-08-17T02:26:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.435+0000 7fe50e600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5080accf0 0x7fe5080b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.435+0000 7fe50e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 0x7fe508157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.435+0000 7fe50e600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5080ae540 con 0x7fe508159610 2024-08-17T02:26:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.435+0000 7fe50e600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5080ad930 con 0x7fe5080accf0 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.435+0000 7fe50e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080adc10 con 0x7fe5080afd90 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5080accf0 0x7fe5080b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5080accf0 0x7fe5080b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47628/0 (socket says 172.21.15.146:47628) 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 -- 172.21.15.146:0/3881216759 learned_addr learned my addr 172.21.15.146:0/3881216759 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507e00640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 0x7fe508157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 -- 172.21.15.146:0/3881216759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 msgr2=0x7fe508157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 0x7fe508157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 -- 172.21.15.146:0/3881216759 >> v1:172.21.15.150:6789/0 conn(0x7fe508159610 legacy=0x7fe5080af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507400640 1 -- 172.21.15.146:0/3881216759 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080adef0 con 0x7fe5080accf0 2024-08-17T02:26:50.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.436+0000 7fe507e00640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 0x7fe508157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.437+0000 7fe507400640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5080accf0 0x7fe5080b1670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009910 tx=0x7fe4f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbbe7ead400ba52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.437+0000 7fe506000640 1 -- 172.21.15.146:0/3881216759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f802ae40 con 0x7fe5080accf0 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.437+0000 7fe506000640 1 -- 172.21.15.146:0/3881216759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8032440 con 0x7fe5080accf0 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.437+0000 7fe506000640 1 -- 172.21.15.146:0/3881216759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8032820 con 0x7fe5080accf0 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 -- 172.21.15.146:0/3881216759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5080accf0 msgr2=0x7fe5080b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5080accf0 0x7fe5080b1670 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009910 tx=0x7fe4f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 -- 172.21.15.146:0/3881216759 shutdown_connections 2024-08-17T02:26:50.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080afd90 0x7fe508157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 --2- 172.21.15.146:0/3881216759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5080accf0 0x7fe5080b1670 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 -- 172.21.15.146:0/3881216759 >> 172.21.15.146:0/3881216759 conn(0x7fe508067750 msgr2=0x7fe5080cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:50.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 -- 172.21.15.146:0/3881216759 shutdown_connections 2024-08-17T02:26:50.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.438+0000 7fe50e600640 1 -- 172.21.15.146:0/3881216759 wait complete. 2024-08-17T02:26:50.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.439+0000 7fe50e600640 1 Processor -- start 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 -- start start 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080accf0 0x7fe508169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5080afd90 0x7fe5080c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50815c7c0 con 0x7fe508159610 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50815e410 con 0x7fe5080afd90 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.440+0000 7fe50e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50815a580 con 0x7fe5080accf0 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47638/0 (socket says 172.21.15.146:47638) 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 -- 172.21.15.146:0/2489632983 learned_addr learned my addr 172.21.15.146:0/2489632983 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:50.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe506a00640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5080afd90 0x7fe5080c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507400640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080accf0 0x7fe508169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 -- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080accf0 msgr2=0x7fe508169650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080accf0 0x7fe508169650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 -- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5080afd90 msgr2=0x7fe5080c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5080afd90 0x7fe5080c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 -- 172.21.15.146:0/2489632983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8009450 con 0x7fe508159610 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.441+0000 7fe507e00640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe50000d0d0 tx=0x7fe5000099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.442+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500015440 con 0x7fe508159610 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.442+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000f040 con 0x7fe508159610 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.442+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5000157f0 con 0x7fe508159610 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.442+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe508159c50 con 0x7fe508159610 2024-08-17T02:26:50.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.442+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50815a210 con 0x7fe508159610 2024-08-17T02:26:50.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.443+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508064db0 con 0x7fe508159610 2024-08-17T02:26:50.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.444+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe50001e3b0 con 0x7fe508159610 2024-08-17T02:26:50.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.444+0000 7fe4fea00640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 0x7fe4e8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:50.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.444+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5000826c0 con 0x7fe508159610 2024-08-17T02:26:50.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.445+0000 7fe507400640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 0x7fe4e8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:50.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.445+0000 7fe507400640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 0x7fe4e8067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f8032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:50.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.448+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe500050ae0 con 0x7fe508159610 2024-08-17T02:26:50.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:50.624+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe5080cc480 con 0x7fe508159610 2024-08-17T02:26:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.243+0000 7fe4fea00640 1 -- 172.21.15.146:0/2489632983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe500054100 con 0x7fe508159610 2024-08-17T02:26:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 msgr2=0x7fe4e8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 0x7fe4e8067630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f8032000 comp rx=0 tx=0).stop 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 msgr2=0x7fe5080c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe50000d0d0 tx=0x7fe5000099f0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 shutdown_connections 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe4e8065180 0x7fe4e8067630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe508159610 0x7fe5080c0e00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5080afd90 0x7fe5080c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 --2- 172.21.15.146:0/2489632983 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe5080accf0 0x7fe508169650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 >> 172.21.15.146:0/2489632983 conn(0x7fe508067750 msgr2=0x7fe50815edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 shutdown_connections 2024-08-17T02:26:51.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.247+0000 7fe50e600640 1 -- 172.21.15.146:0/2489632983 wait complete. 2024-08-17T02:26:51.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:51.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.421+0000 7f7481200640 1 Processor -- start 2024-08-17T02:26:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.421+0000 7f7481200640 1 -- start start 2024-08-17T02:26:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7481200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f747c06d7a0 0x7f747c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7481200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f747c154d60 0x7f747c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7481200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0ab4a0 con 0x7f747c0aea90 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7481200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0af600 con 0x7f747c06d7a0 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7481200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0aa8d0 con 0x7f747c154d60 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f747c06d7a0 0x7f747c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f747c06d7a0 0x7f747c06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47652/0 (socket says 172.21.15.146:47652) 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 -- 172.21.15.146:0/3556765889 learned_addr learned my addr 172.21.15.146:0/3556765889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f7472a00640 1 --2- 172.21.15.146:0/3556765889 >> v2:172.21.15.150:3300/0 conn(0x7f747c154d60 0x7f747c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 -- 172.21.15.146:0/3556765889 >> v2:172.21.15.150:3300/0 conn(0x7f747c154d60 msgr2=0x7f747c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 --2- 172.21.15.146:0/3556765889 >> v2:172.21.15.150:3300/0 conn(0x7f747c154d60 0x7f747c1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.423+0000 7f747b400640 1 -- 172.21.15.146:0/3556765889 >> v1:172.21.15.150:6789/0 conn(0x7f747c0aea90 legacy=0x7f747c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.424+0000 7f747b400640 1 -- 172.21.15.146:0/3556765889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c155720 con 0x7f747c06d7a0 2024-08-17T02:26:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.424+0000 7f747b400640 1 --2- 172.21.15.146:0/3556765889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c06d7a0 0x7f747c06db70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f747c06c510 tx=0x7f746c00a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6e870cdd1211eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f747aa00640 1 -- 172.21.15.146:0/3556765889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c030510 con 0x7f747c06d7a0 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f747aa00640 1 -- 172.21.15.146:0/3556765889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c02e050 con 0x7f747c06d7a0 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f747aa00640 1 -- 172.21.15.146:0/3556765889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0308e0 con 0x7f747c06d7a0 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 -- 172.21.15.146:0/3556765889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c06d7a0 msgr2=0x7f747c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 --2- 172.21.15.146:0/3556765889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c06d7a0 0x7f747c06db70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f747c06c510 tx=0x7f746c00a360 comp rx=0 tx=0).stop 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 -- 172.21.15.146:0/3556765889 shutdown_connections 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 --2- 172.21.15.146:0/3556765889 >> v2:172.21.15.150:3300/0 conn(0x7f747c154d60 0x7f747c1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 --2- 172.21.15.146:0/3556765889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c06d7a0 0x7f747c06db70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 -- 172.21.15.146:0/3556765889 >> 172.21.15.146:0/3556765889 conn(0x7f747c067750 msgr2=0x7f747c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.425+0000 7f7481200640 1 -- 172.21.15.146:0/3556765889 shutdown_connections 2024-08-17T02:26:51.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.426+0000 7f7481200640 1 -- 172.21.15.146:0/3556765889 wait complete. 2024-08-17T02:26:51.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.427+0000 7f7481200640 1 Processor -- start 2024-08-17T02:26:51.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.427+0000 7f7481200640 1 -- start start 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747c06d7a0 0x7f747c145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747c0aea90 0x7f747c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c06f0 con 0x7f747c154d60 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c1550 con 0x7f747c0aea90 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7481200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c0940 con 0x7f747c06d7a0 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f747be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f747b400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747c06d7a0 0x7f747c145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f747be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47666/0 (socket says 172.21.15.146:47666) 2024-08-17T02:26:51.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f747be00640 1 -- 172.21.15.146:0/3283631964 learned_addr learned my addr 172.21.15.146:0/3283631964 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.428+0000 7f7472a00640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747c0aea90 0x7f747c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 -- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747c06d7a0 msgr2=0x7f747c145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747c06d7a0 0x7f747c145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 -- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747c0aea90 msgr2=0x7f747c1453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747c0aea90 0x7f747c1453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 -- 172.21.15.146:0/3283631964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c00a600 con 0x7f747c154d60 2024-08-17T02:26:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f747be00640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f747400c890 tx=0x7f7474001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400ce80 con 0x7f747c154d60 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400a850 con 0x7f747c154d60 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400abf0 con 0x7f747c154d60 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c0c0c20 con 0x7f747c154d60 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.429+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c0c11e0 con 0x7f747c154d60 2024-08-17T02:26:51.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.430+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0c16e0 con 0x7f747c154d60 2024-08-17T02:26:51.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.431+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7474012420 con 0x7f747c154d60 2024-08-17T02:26:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.433+0000 7f7473400640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 0x7f7458067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.433+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7474082470 con 0x7f747c154d60 2024-08-17T02:26:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.433+0000 7f747b400640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 0x7f7458067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:51.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.434+0000 7f747b400640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 0x7f7458067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f746c035000 tx=0x7f746c038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:51.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.437+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7474050720 con 0x7f747c154d60 2024-08-17T02:26:51.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:51.610+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f747c071050 con 0x7f747c154d60 2024-08-17T02:26:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.252+0000 7f7473400640 1 -- 172.21.15.146:0/3283631964 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7474053d40 con 0x7f747c154d60 2024-08-17T02:26:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-08-17T02:26:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.257+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 msgr2=0x7f7458067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.257+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 0x7f7458067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f746c035000 tx=0x7f746c038000 comp rx=0 tx=0).stop 2024-08-17T02:26:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.257+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 msgr2=0x7f747c0a8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.257+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f747400c890 tx=0x7f7474001690 comp rx=0 tx=0).stop 2024-08-17T02:26:52.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 shutdown_connections 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7458065150 0x7f7458067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747c154d60 0x7f747c0a8830 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f747c0aea90 0x7f747c1453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 --2- 172.21.15.146:0/3283631964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f747c06d7a0 0x7f747c145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.258+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 >> 172.21.15.146:0/3283631964 conn(0x7f747c067750 msgr2=0x7f747c1511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.259+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 shutdown_connections 2024-08-17T02:26:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.260+0000 7f7481200640 1 -- 172.21.15.146:0/3283631964 wait complete. 2024-08-17T02:26:52.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.440+0000 7f45eae00640 1 Processor -- start 2024-08-17T02:26:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.440+0000 7f45eae00640 1 -- start start 2024-08-17T02:26:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.441+0000 7f45eae00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 0x7f45e40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.441+0000 7f45eae00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45e40c4a20 0x7f45e40ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.441+0000 7f45eae00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e40c61d0 con 0x7f45e4158e00 2024-08-17T02:26:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.441+0000 7f45eae00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40c64b0 con 0x7f45e40c4a20 2024-08-17T02:26:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.441+0000 7f45eae00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40c6790 con 0x7f45e4158a30 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.442+0000 7f45e9a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 0x7f45e40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.442+0000 7f45ea400640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f45e4158e00 0x7f45e415c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:59924/0 (socket says 172.21.15.146:59924) 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.442+0000 7f45ea400640 1 -- 172.21.15.146:0/2603405260 learned_addr learned my addr 172.21.15.146:0/2603405260 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.442+0000 7f45e9000640 1 --2- 172.21.15.146:0/2603405260 >> v2:172.21.15.150:3300/0 conn(0x7f45e40c4a20 0x7f45e40ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.442+0000 7f45e3e00640 1 -- 172.21.15.146:0/2603405260 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982751486 0 0) 0x7f45e40c61d0 con 0x7f45e4158e00 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e3e00640 1 -- 172.21.15.146:0/2603405260 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc0034e0 con 0x7f45e4158e00 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e9000640 1 -- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 msgr2=0x7f45e40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e9000640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 0x7f45e40c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e9000640 1 -- 172.21.15.146:0/2603405260 >> v1:172.21.15.150:6789/0 conn(0x7f45e4158e00 legacy=0x7f45e415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e9000640 1 -- 172.21.15.146:0/2603405260 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40cab70 con 0x7f45e40c4a20 2024-08-17T02:26:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.443+0000 7f45e9a00640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 0x7f45e40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.444+0000 7f45e9000640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e40c4a20 0x7f45e40ce180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009850 tx=0x7f45d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924cb6ab0ba8b00a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.444+0000 7f45e3e00640 1 -- 172.21.15.146:0/2603405260 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d002ad80 con 0x7f45e40c4a20 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.444+0000 7f45e3e00640 1 -- 172.21.15.146:0/2603405260 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0032440 con 0x7f45e40c4a20 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.444+0000 7f45e3e00640 1 -- 172.21.15.146:0/2603405260 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0032800 con 0x7f45e40c4a20 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 -- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e40c4a20 msgr2=0x7f45e40ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e40c4a20 0x7f45e40ce180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009850 tx=0x7f45d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 -- 172.21.15.146:0/2603405260 shutdown_connections 2024-08-17T02:26:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e40c4a20 0x7f45e40ce180 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 --2- 172.21.15.146:0/2603405260 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e4158a30 0x7f45e40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 -- 172.21.15.146:0/2603405260 >> 172.21.15.146:0/2603405260 conn(0x7f45e4098e30 msgr2=0x7f45e406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 -- 172.21.15.146:0/2603405260 shutdown_connections 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.445+0000 7f45eae00640 1 -- 172.21.15.146:0/2603405260 wait complete. 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.446+0000 7f45eae00640 1 Processor -- start 2024-08-17T02:26:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.446+0000 7f45eae00640 1 -- start start 2024-08-17T02:26:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e40c4a20 0x7f45e40c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e4158a30 0x7f45e40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e409d010 con 0x7f45e4158e00 2024-08-17T02:26:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40c7c10 con 0x7f45e4158a30 2024-08-17T02:26:52.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.447+0000 7f45eae00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e409c400 con 0x7f45e40c4a20 2024-08-17T02:26:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47672/0 (socket says 172.21.15.146:47672) 2024-08-17T02:26:52.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 -- 172.21.15.146:0/2510356132 learned_addr learned my addr 172.21.15.146:0/2510356132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45e9000640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e4158a30 0x7f45e40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45e9a00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e40c4a20 0x7f45e40c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 -- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e40c4a20 msgr2=0x7f45e40c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e40c4a20 0x7f45e40c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 -- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e4158a30 msgr2=0x7f45e40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e4158a30 0x7f45e40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 -- 172.21.15.146:0/2510356132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009390 con 0x7f45e4158e00 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.448+0000 7f45ea400640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f45dc001460 tx=0x7f45dc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.449+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00ce30 con 0x7f45e4158e00 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.449+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00a850 con 0x7f45e4158e00 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.449+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00ac50 con 0x7f45e4158e00 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.449+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0009390 con 0x7f45e4158e00 2024-08-17T02:26:52.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.449+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e409c9c0 con 0x7f45e4158e00 2024-08-17T02:26:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.450+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e409d180 con 0x7f45e4158e00 2024-08-17T02:26:52.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.451+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45dc007300 con 0x7f45e4158e00 2024-08-17T02:26:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.452+0000 7f45e0c00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 0x7f45c4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.452+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f45dc082480 con 0x7f45e4158e00 2024-08-17T02:26:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.452+0000 7f45e9a00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 0x7f45c4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:52.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.452+0000 7f45e9a00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 0x7f45c4067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009eb0 tx=0x7f45d80090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:52.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.456+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45dc050630 con 0x7f45e4158e00 2024-08-17T02:26:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:52.666+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45e4071050 con 0x7f45e4158e00 2024-08-17T02:26:53.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.271+0000 7f45e0c00640 1 -- 172.21.15.146:0/2510356132 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45dc053c50 con 0x7f45e4158e00 2024-08-17T02:26:53.272 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 msgr2=0x7f45c4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 0x7f45c4067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009eb0 tx=0x7f45d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 msgr2=0x7f45e41492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f45dc001460 tx=0x7f45dc001a40 comp rx=0 tx=0).stop 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 shutdown_connections 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f45c4065180 0x7f45c4067630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e4158e00 0x7f45e41492b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e4158a30 0x7f45e40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 --2- 172.21.15.146:0/2510356132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e40c4a20 0x7f45e40c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.276+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 >> 172.21.15.146:0/2510356132 conn(0x7f45e4098e30 msgr2=0x7f45e4067420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.277+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 shutdown_connections 2024-08-17T02:26:53.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.277+0000 7f45eae00640 1 -- 172.21.15.146:0/2510356132 wait complete. 2024-08-17T02:26:53.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.456+0000 7f4ea6400640 1 Processor -- start 2024-08-17T02:26:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.457+0000 7f4ea6400640 1 -- start start 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea00ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 0x7f4ea00afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ea00b03d0 0x7f4ea015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea00ab950 con 0x7f4ea00b03d0 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea00abc30 con 0x7f4ea00a98e0 2024-08-17T02:26:53.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea6400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea00abf10 con 0x7f4ea00cc010 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea5a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ea00b03d0 0x7f4ea015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea5a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ea00b03d0 0x7f4ea015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47686/0 (socket says 172.21.15.146:47686) 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea5a00640 1 -- 172.21.15.146:0/3104776273 learned_addr learned my addr 172.21.15.146:0/3104776273 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4e97e00640 1 --2- 172.21.15.146:0/3104776273 >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 0x7f4ea00afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.458+0000 7f4ea5000640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea00ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 -- 172.21.15.146:0/3104776273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 msgr2=0x7f4ea00ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea00ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 -- 172.21.15.146:0/3104776273 >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 msgr2=0x7f4ea00afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 --2- 172.21.15.146:0/3104776273 >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 0x7f4ea00afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 -- 172.21.15.146:0/3104776273 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea00af970 con 0x7f4ea00b03d0 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4e97e00640 1 --2- 172.21.15.146:0/3104776273 >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 0x7f4ea00afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.459+0000 7f4ea5a00640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00b03d0 0x7f4ea015c7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0064c60 tx=0x7f4e98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccc405777f917a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4e9fe00640 1 -- 172.21.15.146:0/3104776273 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98031400 con 0x7f4ea00b03d0 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4e9fe00640 1 -- 172.21.15.146:0/3104776273 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9802d050 con 0x7f4ea00b03d0 2024-08-17T02:26:53.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4e9fe00640 1 -- 172.21.15.146:0/3104776273 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e980317d0 con 0x7f4ea00b03d0 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 -- 172.21.15.146:0/3104776273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00b03d0 msgr2=0x7f4ea015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00b03d0 0x7f4ea015c7c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0064c60 tx=0x7f4e98009840 comp rx=0 tx=0).stop 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 -- 172.21.15.146:0/3104776273 shutdown_connections 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00b03d0 0x7f4ea015c7c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3104776273 >> v2:172.21.15.150:3300/0 conn(0x7f4ea00a98e0 0x7f4ea00afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3104776273 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea00ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 -- 172.21.15.146:0/3104776273 >> 172.21.15.146:0/3104776273 conn(0x7f4ea0067de0 msgr2=0x7f4ea00681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.460+0000 7f4ea6400640 1 -- 172.21.15.146:0/3104776273 shutdown_connections 2024-08-17T02:26:53.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.461+0000 7f4ea6400640 1 -- 172.21.15.146:0/3104776273 wait complete. 2024-08-17T02:26:53.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.462+0000 7f4ea6400640 1 Processor -- start 2024-08-17T02:26:53.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.462+0000 7f4ea6400640 1 -- start start 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea00b03d0 0x7f4ea0169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea0152040 con 0x7f4ea00a98e0 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01522e0 con 0x7f4ea00b03d0 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea6400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01525c0 con 0x7f4ea00cc010 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea5000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47700/0 (socket says 172.21.15.146:47700) 2024-08-17T02:26:53.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea5000640 1 -- 172.21.15.146:0/3848292632 learned_addr learned my addr 172.21.15.146:0/3848292632 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4ea5a00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.463+0000 7f4e97e00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea00b03d0 0x7f4ea0169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 -- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 msgr2=0x7f4ea015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 -- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea00b03d0 msgr2=0x7f4ea0169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea00b03d0 0x7f4ea0169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 -- 172.21.15.146:0/3848292632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98009ae0 con 0x7f4ea00a98e0 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5a00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea5000640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d890 tx=0x7f4e90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000de20 con 0x7f4ea00a98e0 2024-08-17T02:26:53.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000b8d0 con 0x7f4ea00a98e0 2024-08-17T02:26:53.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea01528a0 con 0x7f4ea00a98e0 2024-08-17T02:26:53.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000bc70 con 0x7f4ea00a98e0 2024-08-17T02:26:53.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.464+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea0152e60 con 0x7f4ea00a98e0 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.465+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea01538c0 con 0x7f4ea00a98e0 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.466+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4e90014640 con 0x7f4ea00a98e0 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.467+0000 7f4e9cc00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 0x7f4e7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.467+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e90082b40 con 0x7f4ea00a98e0 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.467+0000 7f4e97e00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 0x7f4e7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.468+0000 7f4e97e00640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 0x7f4e7c067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae810 tx=0x7f4e88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.471+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4e90050b60 con 0x7f4ea00a98e0 2024-08-17T02:26:53.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.645+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ea0071050 con 0x7f4ea00a98e0 2024-08-17T02:26:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.646+0000 7f4e9cc00640 1 -- 172.21.15.146:0/3848292632 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f4e90054180 con 0x7f4ea00a98e0 2024-08-17T02:26:53.646 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:53.646 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:52.667202+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 msgr2=0x7f4e7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 0x7f4e7c067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae810 tx=0x7f4e88008040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 msgr2=0x7f4ea0153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d890 tx=0x7f4e90008040 comp rx=0 tx=0).stop 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 shutdown_connections 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4e7c065150 0x7f4e7c067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ea00cc010 0x7f4ea015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ea00b03d0 0x7f4ea0169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 --2- 172.21.15.146:0/3848292632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea00a98e0 0x7f4ea0153380 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 >> 172.21.15.146:0/3848292632 conn(0x7f4ea0067de0 msgr2=0x7f4ea00b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 shutdown_connections 2024-08-17T02:26:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.648+0000 7f4ea6400640 1 -- 172.21.15.146:0/3848292632 wait complete. 2024-08-17T02:26:53.664 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.812+0000 7fa51b200640 1 Processor -- start 2024-08-17T02:26:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.813+0000 7fa51b200640 1 -- start start 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 0x7fa51c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51b200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cbea0 0x7fa51c0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0cc2b0 con 0x7fa51c15d4b0 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51b200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0aa0d0 con 0x7fa51c0cbea0 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0cc4f0 con 0x7fa51c06d7a0 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa519400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cbea0 0x7fa51c0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa519400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa51c0cbea0 0x7fa51c0aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47710/0 (socket says 172.21.15.146:47710) 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa519400640 1 -- 172.21.15.146:0/3315221478 learned_addr learned my addr 172.21.15.146:0/3315221478 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa51a800640 1 --1- 172.21.15.146:0/3315221478 >> v1:172.21.15.146:6789/0 conn(0x7fa51c15d4b0 0x7fa51c1588a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36334/0 (socket says 172.21.15.146:36334) 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.814+0000 7fa519e00640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 0x7fa51c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa519400640 1 -- 172.21.15.146:0/3315221478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 msgr2=0x7fa51c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa519400640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 0x7fa51c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa519400640 1 -- 172.21.15.146:0/3315221478 >> v1:172.21.15.146:6789/0 conn(0x7fa51c15d4b0 legacy=0x7fa51c1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa519400640 1 -- 172.21.15.146:0/3315221478 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0a9a80 con 0x7fa51c0cbea0 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa519e00640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 0x7fa51c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.815+0000 7fa518a00640 1 -- 172.21.15.146:0/3315221478 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595932109 0 0) 0x7fa514001490 con 0x7fa51c15d4b0 2024-08-17T02:26:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa519400640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0aa560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa508009910 tx=0x7fa5080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d9a6413900b153 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa518a00640 1 -- 172.21.15.146:0/3315221478 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508032440 con 0x7fa51c0cbea0 2024-08-17T02:26:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa518a00640 1 -- 172.21.15.146:0/3315221478 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080325a0 con 0x7fa51c0cbea0 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa518a00640 1 -- 172.21.15.146:0/3315221478 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508032940 con 0x7fa51c0cbea0 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa51b200640 1 -- 172.21.15.146:0/3315221478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0cbea0 msgr2=0x7fa51c0aa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.816+0000 7fa51b200640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0aa560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa508009910 tx=0x7fa5080091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 -- 172.21.15.146:0/3315221478 shutdown_connections 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0aa560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 --2- 172.21.15.146:0/3315221478 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c06d7a0 0x7fa51c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 -- 172.21.15.146:0/3315221478 >> 172.21.15.146:0/3315221478 conn(0x7fa51c067750 msgr2=0x7fa51c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 -- 172.21.15.146:0/3315221478 shutdown_connections 2024-08-17T02:26:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.817+0000 7fa51b200640 1 -- 172.21.15.146:0/3315221478 wait complete. 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.818+0000 7fa51b200640 1 Processor -- start 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.818+0000 7fa51b200640 1 -- start start 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 0x7fa51c14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c14f950 con 0x7fa51c06d7a0 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c14ed40 con 0x7fa51c0cbea0 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa51b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c14f020 con 0x7fa51c15d4b0 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa519e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa519e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47720/0 (socket says 172.21.15.146:47720) 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.819+0000 7fa519e00640 1 -- 172.21.15.146:0/2120085375 learned_addr learned my addr 172.21.15.146:0/2120085375 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa51a800640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 0x7fa51c14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519400640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 -- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 msgr2=0x7fa51c14fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 0x7fa51c14fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 -- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 msgr2=0x7fa51c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 -- 172.21.15.146:0/2120085375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508009450 con 0x7fa51c06d7a0 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519400640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa51a800640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 0x7fa51c14fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa519e00640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c880 tx=0x7fa50c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00ce10 con 0x7fa51c06d7a0 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c007890 con 0x7fa51c06d7a0 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c007c10 con 0x7fa51c06d7a0 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c14f300 con 0x7fa51c06d7a0 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.820+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c0acda0 con 0x7fa51c06d7a0 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.821+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c071050 con 0x7fa51c06d7a0 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.822+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa50c0113f0 con 0x7fa51c06d7a0 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.823+0000 7fa511600640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 0x7fa4fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.823+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa50c082410 con 0x7fa51c06d7a0 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.823+0000 7fa519400640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 0x7fa4fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.824+0000 7fa519400640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 0x7fa4fc067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa508034000 tx=0x7fa508032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:53.827+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa50c053f60 con 0x7fa51c06d7a0 2024-08-17T02:26:54.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.000+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa51c06e6e0 con 0x7fa51c06d7a0 2024-08-17T02:26:54.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.001+0000 7fa511600640 1 -- 172.21.15.146:0/2120085375 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fa50c053af0 con 0x7fa51c06d7a0 2024-08-17T02:26:54.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:54.001 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:52.667202+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 msgr2=0x7fa4fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 0x7fa4fc067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa508034000 tx=0x7fa508032000 comp rx=0 tx=0).stop 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 msgr2=0x7fa51c14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c880 tx=0x7fa50c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 shutdown_connections 2024-08-17T02:26:54.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa4fc065150 0x7fa4fc067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa51c15d4b0 0x7fa51c14fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa51c0cbea0 0x7fa51c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 --2- 172.21.15.146:0/2120085375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51c06d7a0 0x7fa51c14e740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 >> 172.21.15.146:0/2120085375 conn(0x7fa51c067750 msgr2=0x7fa51c156420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 shutdown_connections 2024-08-17T02:26:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.003+0000 7fa51b200640 1 -- 172.21.15.146:0/2120085375 wait complete. 2024-08-17T02:26:54.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:54.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.171+0000 7f46dee00640 1 Processor -- start 2024-08-17T02:26:54.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.171+0000 7f46dee00640 1 -- start start 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46dee00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f46d80c92e0 0x7f46d8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46dee00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d81598f0 con 0x7f46d80c7db0 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46dee00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d8159bd0 con 0x7f46d8155a80 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46dee00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d8159eb0 con 0x7f46d80c92e0 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46cfe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f46d80c7db0 0x7f46d80c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36346/0 (socket says 172.21.15.146:36346) 2024-08-17T02:26:54.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46cfe00640 1 -- 172.21.15.146:0/2245709812 learned_addr learned my addr 172.21.15.146:0/2245709812 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:54.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46dce00640 1 --2- 172.21.15.146:0/2245709812 >> v2:172.21.15.150:3300/0 conn(0x7f46d80c92e0 0x7f46d8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640219075 0 0) 0x7f46d81598f0 con 0x7f46d80c7db0 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.173+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46bc0034e0 con 0x7f46d80c7db0 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.174+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060730876 0 0) 0x7f46d8159bd0 con 0x7f46d8155a80 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.174+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d81598f0 con 0x7f46d8155a80 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.174+0000 7f46dce00640 1 -- 172.21.15.146:0/2245709812 >> v1:172.21.15.150:6789/0 conn(0x7f46d8155a80 legacy=0x7f46d806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.174+0000 7f46dce00640 1 -- 172.21.15.146:0/2245709812 >> v1:172.21.15.146:6789/0 conn(0x7f46d80c7db0 legacy=0x7f46d80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.174+0000 7f46dce00640 1 -- 172.21.15.146:0/2245709812 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d815a190 con 0x7f46d80c92e0 2024-08-17T02:26:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.175+0000 7f46dce00640 1 --2- 172.21.15.146:0/2245709812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d80c92e0 0x7f46d8160b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009e60 tx=0x7f46d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c244571f2073089 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.175+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0030560 con 0x7f46d80c92e0 2024-08-17T02:26:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.175+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d00306c0 con 0x7f46d80c92e0 2024-08-17T02:26:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.175+0000 7f46d7400640 1 -- 172.21.15.146:0/2245709812 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0030a60 con 0x7f46d80c92e0 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 -- 172.21.15.146:0/2245709812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d80c92e0 msgr2=0x7f46d8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 --2- 172.21.15.146:0/2245709812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d80c92e0 0x7f46d8160b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009e60 tx=0x7f46d0009780 comp rx=0 tx=0).stop 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 -- 172.21.15.146:0/2245709812 shutdown_connections 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 --2- 172.21.15.146:0/2245709812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d80c92e0 0x7f46d8160b90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 -- 172.21.15.146:0/2245709812 >> 172.21.15.146:0/2245709812 conn(0x7f46d8067750 msgr2=0x7f46d80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 -- 172.21.15.146:0/2245709812 shutdown_connections 2024-08-17T02:26:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.176+0000 7f46dee00640 1 -- 172.21.15.146:0/2245709812 wait complete. 2024-08-17T02:26:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.178+0000 7f46dee00640 1 Processor -- start 2024-08-17T02:26:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.178+0000 7f46dee00640 1 -- start start 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46d80c7db0 0x7f46d81682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d8155a80 0x7f46d80ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8156220 con 0x7f46d80c92e0 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8155ef0 con 0x7f46d8155a80 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dee00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8167a70 con 0x7f46d80c7db0 2024-08-17T02:26:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47728/0 (socket says 172.21.15.146:47728) 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 -- 172.21.15.146:0/3690939561 learned_addr learned my addr 172.21.15.146:0/3690939561 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46dce00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d8155a80 0x7f46d80ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46d7e00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46d80c7db0 0x7f46d81682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 -- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46d80c7db0 msgr2=0x7f46d81682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46d80c7db0 0x7f46d81682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 -- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d8155a80 msgr2=0x7f46d80ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d8155a80 0x7f46d80ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.179+0000 7f46cfe00640 1 -- 172.21.15.146:0/3690939561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d0009a20 con 0x7f46d80c92e0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46cfe00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c790 tx=0x7f46c0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000ce60 con 0x7f46d80c92e0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c0005870 con 0x7f46d80c92e0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0005c30 con 0x7f46d80c92e0 2024-08-17T02:26:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d8167d50 con 0x7f46d80c92e0 2024-08-17T02:26:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.180+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d81676c0 con 0x7f46d80c92e0 2024-08-17T02:26:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.181+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d8071050 con 0x7f46d80c92e0 2024-08-17T02:26:54.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.182+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f46c0007300 con 0x7f46d80c92e0 2024-08-17T02:26:54.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.183+0000 7f46cf400640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 0x7f46b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:54.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.183+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46c0081df0 con 0x7f46d80c92e0 2024-08-17T02:26:54.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.184+0000 7f46d7e00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 0x7f46b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:54.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.184+0000 7f46d7e00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 0x7f46b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c8003970 tx=0x7f46c8007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:54.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.187+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46c00539d0 con 0x7f46d80c92e0 2024-08-17T02:26:54.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:54.401+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46d80c98d0 con 0x7f46d80c92e0 2024-08-17T02:26:55.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.279+0000 7f46cf400640 1 -- 172.21.15.146:0/3690939561 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46c0053560 con 0x7f46d80c92e0 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 msgr2=0x7f46b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 0x7f46b4067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46c8003970 tx=0x7f46c8007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 msgr2=0x7f46d8167100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c790 tx=0x7f46c0007db0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 shutdown_connections 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f46b4065150 0x7f46b4067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46d80c92e0 0x7f46d8167100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46d8155a80 0x7f46d80ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 --2- 172.21.15.146:0/3690939561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f46d80c7db0 0x7f46d81682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.281+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 >> 172.21.15.146:0/3690939561 conn(0x7f46d8067750 msgr2=0x7f46d80afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.282+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 shutdown_connections 2024-08-17T02:26:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.282+0000 7f46dee00640 1 -- 172.21.15.146:0/3690939561 wait complete. 2024-08-17T02:26:55.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:55.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.452+0000 7f1b5e200640 1 Processor -- start 2024-08-17T02:26:55.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.452+0000 7f1b5e200640 1 -- start start 2024-08-17T02:26:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b5e200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b580ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b5e200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1b5815c5c0 0x7f1b580abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b5e200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b580ad290 con 0x7f1b5815c1f0 2024-08-17T02:26:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b5e200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580b0e20 con 0x7f1b5815c5c0 2024-08-17T02:26:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b5e200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ac370 con 0x7f1b58097180 2024-08-17T02:26:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b57400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b5815c1f0 0x7f1b58096a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48950/0 (socket says 172.21.15.146:48950) 2024-08-17T02:26:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.453+0000 7f1b57400640 1 -- 172.21.15.146:0/2661213740 learned_addr learned my addr 172.21.15.146:0/2661213740 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b57e00640 1 --2- 172.21.15.146:0/2661213740 >> v2:172.21.15.150:3300/0 conn(0x7f1b5815c5c0 0x7f1b580abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b580ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949521481 0 0) 0x7f1b580ad290 con 0x7f1b5815c1f0 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b3c0034e0 con 0x7f1b5815c1f0 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022254179 0 0) 0x7f1b3c0034e0 con 0x7f1b5815c1f0 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 msgr2=0x7f1b580ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b580ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 >> v2:172.21.15.150:3300/0 conn(0x7f1b5815c5c0 msgr2=0x7f1b580abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 --2- 172.21.15.146:0/2661213740 >> v2:172.21.15.150:3300/0 conn(0x7f1b5815c5c0 0x7f1b580abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580ac650 con 0x7f1b5815c1f0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f1b48001490 con 0x7f1b5815c1f0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 >> v1:172.21.15.146:6789/0 conn(0x7f1b5815c1f0 legacy=0x7f1b58096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b3c0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c003f50 0x7f1b3c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b3c004cc0 0x7f1b3c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580b0e20 con 0x7f1b3c004cc0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580ac370 con 0x7f1b3c003f50 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.454+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c00ba00 con 0x7f1b58097180 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b3c0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57e00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b3c004cc0 0x7f1b3c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c003f50 0x7f1b3c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 -- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c003f50 msgr2=0x7f1b3c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c003f50 0x7f1b3c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 -- 172.21.15.146:0/2661213740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b3c004cc0 msgr2=0x7f1b3c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b3c004cc0 0x7f1b3c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57400640 1 -- 172.21.15.146:0/2661213740 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0034e0 con 0x7f1b58097180 2024-08-17T02:26:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b57e00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b3c004cc0 0x7f1b3c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.455+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b3c003f50 0x7f1b3c004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.456+0000 7f1b57400640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b3c0039d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b580acfb0 tx=0x7f1b480078b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9bc39d6c2052cfb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.456+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48005890 con 0x7f1b58097180 2024-08-17T02:26:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b480059f0 con 0x7f1b58097180 2024-08-17T02:26:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b56a00640 1 -- 172.21.15.146:0/2661213740 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48005df0 con 0x7f1b58097180 2024-08-17T02:26:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 -- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 msgr2=0x7f1b3c0039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 --2- 172.21.15.146:0/2661213740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b58097180 0x7f1b3c0039d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b580acfb0 tx=0x7f1b480078b0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b57e00640 1 -- 172.21.15.146:0/2661213740 reap_dead start 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 -- 172.21.15.146:0/2661213740 shutdown_connections 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 -- 172.21.15.146:0/2661213740 >> 172.21.15.146:0/2661213740 conn(0x7f1b580b2fd0 msgr2=0x7f1b580b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 -- 172.21.15.146:0/2661213740 shutdown_connections 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.457+0000 7f1b5e200640 1 -- 172.21.15.146:0/2661213740 wait complete. 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.459+0000 7f1b5e200640 1 Processor -- start 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.459+0000 7f1b5e200640 1 -- start start 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b58097180 0x7f1b58144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 0x7f1b5806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580afdc0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5806c090 con 0x7f1b58097180 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b5e200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58155a30 con 0x7f1b5806b6b0 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39646/0 (socket says 172.21.15.146:39646) 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 -- 172.21.15.146:0/377384650 learned_addr learned my addr 172.21.15.146:0/377384650 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b57e00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 0x7f1b5806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b57400640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b58097180 0x7f1b58144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 -- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 msgr2=0x7f1b5806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 0x7f1b5806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 -- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b58097180 msgr2=0x7f1b58144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b58097180 0x7f1b58144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b4fe00640 1 -- 172.21.15.146:0/377384650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580ccea0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.460+0000 7f1b57e00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 0x7f1b5806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b4fe00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1b40011d50 tx=0x7f1b400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000fec0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40011e50 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40014670 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580cdce0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.461+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580cd0d0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.462+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580cde70 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.463+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b40014a60 con 0x7f1b580cc4f0 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.463+0000 7f1b4ea00640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 0x7f1b34067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.464+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b40018070 con 0x7f1b580cc4f0 2024-08-17T02:26:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.464+0000 7f1b57400640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 0x7f1b34067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.464+0000 7f1b57400640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 0x7f1b34067630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b48033000 tx=0x7f1b48034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.467+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b400512d0 con 0x7f1b580cc4f0 2024-08-17T02:26:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:55.676+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1b58071050 con 0x7f1b580cc4f0 2024-08-17T02:26:56.219 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-08-17T02:26:56.219+0000 7f9e24000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:56.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.285+0000 7f1b4ea00640 1 -- 172.21.15.146:0/377384650 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b400548f0 con 0x7f1b580cc4f0 2024-08-17T02:26:56.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 msgr2=0x7f1b34067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 0x7f1b34067630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b48033000 tx=0x7f1b48034000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 msgr2=0x7f1b580cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1b40011d50 tx=0x7f1b400090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 shutdown_connections 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1b34065180 0x7f1b34067630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b580cc4f0 0x7f1b580cc960 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1b5806b6b0 0x7f1b5806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 --2- 172.21.15.146:0/377384650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b58097180 0x7f1b58144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 >> 172.21.15.146:0/377384650 conn(0x7f1b580b2fd0 msgr2=0x7f1b5806a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 shutdown_connections 2024-08-17T02:26:56.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.287+0000 7f1b5e200640 1 -- 172.21.15.146:0/377384650 wait complete. 2024-08-17T02:26:56.303 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:56.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.454+0000 7f622b200640 1 Processor -- start 2024-08-17T02:26:56.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.454+0000 7f622b200640 1 -- start start 2024-08-17T02:26:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f622b200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f62240caa40 0x7f62240ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f622b200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240cb560 con 0x7f6224159350 2024-08-17T02:26:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f622b200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240cf7e0 con 0x7f6224158f80 2024-08-17T02:26:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f622b200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62240cfac0 con 0x7f62240caa40 2024-08-17T02:26:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f6229200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6224159350 0x7f62240ad380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48958/0 (socket says 172.21.15.146:48958) 2024-08-17T02:26:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.455+0000 7f6229200640 1 -- 172.21.15.146:0/3294263115 learned_addr learned my addr 172.21.15.146:0/3294263115 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f621b400640 1 --2- 172.21.15.146:0/3294263115 >> v2:172.21.15.150:3300/0 conn(0x7f62240caa40 0x7f62240ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725465437 0 0) 0x7f62240cb560 con 0x7f6224159350 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62080034e0 con 0x7f6224159350 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f621b400640 1 -- 172.21.15.146:0/3294263115 >> v1:172.21.15.150:6789/0 conn(0x7f6224158f80 legacy=0x7f62240ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f621b400640 1 -- 172.21.15.146:0/3294263115 >> v1:172.21.15.146:6789/0 conn(0x7f6224159350 legacy=0x7f62240ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461202695 0 0) 0x7f62080034e0 con 0x7f6224159350 2024-08-17T02:26:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.456+0000 7f621b400640 1 -- 172.21.15.146:0/3294263115 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240caf10 con 0x7f62240caa40 2024-08-17T02:26:56.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.457+0000 7f621b400640 1 --2- 172.21.15.146:0/3294263115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f62240ace40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f620c009850 tx=0x7f620c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780214ff415a93b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.457+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0017f0 con 0x7f62240caa40 2024-08-17T02:26:56.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.457+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c02ab00 con 0x7f62240caa40 2024-08-17T02:26:56.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.457+0000 7f6223400640 1 -- 172.21.15.146:0/3294263115 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c02aea0 con 0x7f62240caa40 2024-08-17T02:26:56.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 -- 172.21.15.146:0/3294263115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 msgr2=0x7f62240ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 --2- 172.21.15.146:0/3294263115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f62240ace40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f620c009850 tx=0x7f620c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 -- 172.21.15.146:0/3294263115 shutdown_connections 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 --2- 172.21.15.146:0/3294263115 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f62240ace40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 -- 172.21.15.146:0/3294263115 >> 172.21.15.146:0/3294263115 conn(0x7f62240cfd90 msgr2=0x7f62240d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 -- 172.21.15.146:0/3294263115 shutdown_connections 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.458+0000 7f622b200640 1 -- 172.21.15.146:0/3294263115 wait complete. 2024-08-17T02:26:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.460+0000 7f622b200640 1 Processor -- start 2024-08-17T02:26:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.460+0000 7f622b200640 1 -- start start 2024-08-17T02:26:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.460+0000 7f622b200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f622415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.460+0000 7f622b200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.460+0000 7f622b200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6224159350 0x7f622416cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f622b200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62241690e0 con 0x7f6224158f80 2024-08-17T02:26:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f622b200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224169330 con 0x7f62240caa40 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f622b200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6224169610 con 0x7f6224159350 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39648/0 (socket says 172.21.15.146:39648) 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 -- 172.21.15.146:0/2299329993 learned_addr learned my addr 172.21.15.146:0/2299329993 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f6223e00640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f622415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f6229200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6224159350 0x7f622416cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 -- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6224159350 msgr2=0x7f622416cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6224159350 0x7f622416cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 -- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 msgr2=0x7f622415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f622415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f621b400640 1 -- 172.21.15.146:0/2299329993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c009390 con 0x7f6224158f80 2024-08-17T02:26:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.461+0000 7f6223e00640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f622415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f621b400640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f620c009850 tx=0x7f620c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c031780 con 0x7f6224158f80 2024-08-17T02:26:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c031900 con 0x7f6224158f80 2024-08-17T02:26:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c031cc0 con 0x7f6224158f80 2024-08-17T02:26:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62241698f0 con 0x7f6224158f80 2024-08-17T02:26:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.462+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240b26a0 con 0x7f6224158f80 2024-08-17T02:26:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.463+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6224064db0 con 0x7f6224158f80 2024-08-17T02:26:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.464+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f620c043030 con 0x7f6224158f80 2024-08-17T02:26:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.465+0000 7f621be00640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 0x7f6200067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.465+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f620c041070 con 0x7f6224158f80 2024-08-17T02:26:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.465+0000 7f6223e00640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 0x7f6200067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.466+0000 7f6223e00640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 0x7f6200067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6214001820 tx=0x7f6214009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.469+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f620c070b60 con 0x7f6224158f80 2024-08-17T02:26:56.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.680+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62240cd3b0 con 0x7f6224158f80 2024-08-17T02:26:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.681+0000 7f621be00640 1 -- 172.21.15.146:0/2299329993 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f620c04b090 con 0x7f6224158f80 2024-08-17T02:26:56.681 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:56.681 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4930,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 17 2024-08-17T02:26:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 msgr2=0x7f6200067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 0x7f6200067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6214001820 tx=0x7f6214009040 comp rx=0 tx=0).stop 2024-08-17T02:26:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 msgr2=0x7f622416c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f620c009850 tx=0x7f620c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 shutdown_connections 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6200065150 0x7f6200067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6224158f80 0x7f622416c740 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6224159350 0x7f622416cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 --2- 172.21.15.146:0/2299329993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62240caa40 0x7f622415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 >> 172.21.15.146:0/2299329993 conn(0x7f62240cfd90 msgr2=0x7f6224156940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 shutdown_connections 2024-08-17T02:26:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.683+0000 7f622b200640 1 -- 172.21.15.146:0/2299329993 wait complete. 2024-08-17T02:26:56.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:56.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.847+0000 7f50e4800640 1 Processor -- start 2024-08-17T02:26:56.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.847+0000 7f50e4800640 1 -- start start 2024-08-17T02:26:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.848+0000 7f50e4800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50dc155550 0x7f50dc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.848+0000 7f50e4800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0afc10 con 0x7f50dc155180 2024-08-17T02:26:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.848+0000 7f50e4800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0af000 con 0x7f50dc06e080 2024-08-17T02:26:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.848+0000 7f50e4800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0af2e0 con 0x7f50dc155550 2024-08-17T02:26:56.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50dc155550 0x7f50dc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f50dc155180 0x7f50dc0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48968/0 (socket says 172.21.15.146:48968) 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50dc155550 0x7f50dc0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39654/0 (socket says 172.21.15.146:39654) 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1e00640 1 -- 172.21.15.146:0/1556336877 learned_addr learned my addr 172.21.15.146:0/1556336877 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1400640 1 -- 172.21.15.146:0/1556336877 >> v1:172.21.15.150:6789/0 conn(0x7f50dc06e080 legacy=0x7f50dc06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1400640 1 -- 172.21.15.146:0/1556336877 >> v1:172.21.15.146:6789/0 conn(0x7f50dc155180 legacy=0x7f50dc0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e1400640 1 -- 172.21.15.146:0/1556336877 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0af5c0 con 0x7f50dc155550 2024-08-17T02:26:56.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.849+0000 7f50e0a00640 1 -- 172.21.15.146:0/1556336877 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772993852 0 0) 0x7f50dc0afc10 con 0x7f50dc155180 2024-08-17T02:26:56.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.850+0000 7f50e1400640 1 --2- 172.21.15.146:0/1556336877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc155550 0x7f50dc0aea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009850 tx=0x7f50cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ef4974c1c48c78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.850+0000 7f50e0a00640 1 -- 172.21.15.146:0/1556336877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc02ae20 con 0x7f50dc155550 2024-08-17T02:26:56.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.850+0000 7f50e0a00640 1 -- 172.21.15.146:0/1556336877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc032440 con 0x7f50dc155550 2024-08-17T02:26:56.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.850+0000 7f50e0a00640 1 -- 172.21.15.146:0/1556336877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0327e0 con 0x7f50dc155550 2024-08-17T02:26:56.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 -- 172.21.15.146:0/1556336877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc155550 msgr2=0x7f50dc0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 --2- 172.21.15.146:0/1556336877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc155550 0x7f50dc0aea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009850 tx=0x7f50cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 -- 172.21.15.146:0/1556336877 shutdown_connections 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 --2- 172.21.15.146:0/1556336877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc155550 0x7f50dc0aea20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 -- 172.21.15.146:0/1556336877 >> 172.21.15.146:0/1556336877 conn(0x7f50dc0cb9b0 msgr2=0x7f50dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 -- 172.21.15.146:0/1556336877 shutdown_connections 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.851+0000 7f50e4800640 1 -- 172.21.15.146:0/1556336877 wait complete. 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.852+0000 7f50e4800640 1 Processor -- start 2024-08-17T02:26:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 -- start start 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50dc155180 0x7f50dc14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50dc155550 0x7f50dc14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc167e20 con 0x7f50dc06e080 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc14faf0 con 0x7f50dc155180 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.853+0000 7f50e4800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc167a10 con 0x7f50dc155550 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39660/0 (socket says 172.21.15.146:39660) 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 -- 172.21.15.146:0/3937504856 learned_addr learned my addr 172.21.15.146:0/3937504856 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:56.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 -- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50dc155550 msgr2=0x7f50dc14f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50dc155550 0x7f50dc14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 -- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50dc155180 msgr2=0x7f50dc14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50dc155180 0x7f50dc14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 -- 172.21.15.146:0/3937504856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009390 con 0x7f50dc06e080 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50e1e00640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c5e0 tx=0x7f50d0007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.854+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0005aa0 con 0x7f50dc06e080 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.855+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0005c20 con 0x7f50dc06e080 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.855+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00070f0 con 0x7f50dc06e080 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.855+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc168000 con 0x7f50dc06e080 2024-08-17T02:26:56.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.855+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc150b20 con 0x7f50dc06e080 2024-08-17T02:26:56.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.856+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc150d70 con 0x7f50dc06e080 2024-08-17T02:26:56.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.856+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50d0007520 con 0x7f50dc06e080 2024-08-17T02:26:56.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.857+0000 7f50d5600640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 0x7f50c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.857+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d0081e40 con 0x7f50dc06e080 2024-08-17T02:26:56.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.857+0000 7f50e1400640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 0x7f50c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.858+0000 7f50e1400640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 0x7f50c0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f50cc034000 tx=0x7f50cc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:56.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:56.861+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f50d004ff80 con 0x7f50dc06e080 2024-08-17T02:26:57.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.035+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50dc064db0 con 0x7f50dc06e080 2024-08-17T02:26:57.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.036+0000 7f50d5600640 1 -- 172.21.15.146:0/3937504856 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f50d00535a0 con 0x7f50dc06e080 2024-08-17T02:26:57.036 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:57.036 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:26:54.264207+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 msgr2=0x7f50c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 0x7f50c0067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f50cc034000 tx=0x7f50cc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 msgr2=0x7f50dc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c5e0 tx=0x7f50d0007d00 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 shutdown_connections 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f50c0065150 0x7f50c0067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f50dc155550 0x7f50dc14f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50dc155180 0x7f50dc14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 --2- 172.21.15.146:0/3937504856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50dc06e080 0x7f50dc1505e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 >> 172.21.15.146:0/3937504856 conn(0x7f50dc0cb9b0 msgr2=0x7f50dc0acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 shutdown_connections 2024-08-17T02:26:57.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.038+0000 7f50e4800640 1 -- 172.21.15.146:0/3937504856 wait complete. 2024-08-17T02:26:57.053 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:57.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:57.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.203+0000 7fa1a1000640 1 Processor -- start 2024-08-17T02:26:57.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.203+0000 7fa1a1000640 1 -- start start 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa1a1000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa19c159ca0 0x7fa19c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa1a1000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0cadc0 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa1a1000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0cb060 con 0x7fa19c0ccca0 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa1a1000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0cd6e0 con 0x7fa19c159ca0 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa19b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa19c159ca0 0x7fa19c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa19b400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa19c159ca0 0x7fa19c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39674/0 (socket says 172.21.15.146:39674) 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa19aa00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa19c0ca8a0 0x7fa19c0cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48984/0 (socket says 172.21.15.146:48984) 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.204+0000 7fa19b400640 1 -- 172.21.15.146:0/2853732502 learned_addr learned my addr 172.21.15.146:0/2853732502 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.205+0000 7fa19b400640 1 -- 172.21.15.146:0/2853732502 >> v1:172.21.15.150:6789/0 conn(0x7fa19c0ccca0 legacy=0x7fa19c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.205+0000 7fa19b400640 1 -- 172.21.15.146:0/2853732502 >> v1:172.21.15.146:6789/0 conn(0x7fa19c0ca8a0 legacy=0x7fa19c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.205+0000 7fa19b400640 1 -- 172.21.15.146:0/2853732502 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0cb300 con 0x7fa19c159ca0 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa19b400640 1 --2- 172.21.15.146:0/2853732502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c159ca0 0x7fa19c0ca360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009910 tx=0x7fa18c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa5460d589fdc93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa19a000640 1 -- 172.21.15.146:0/2853732502 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c02ae70 con 0x7fa19c159ca0 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa19a000640 1 -- 172.21.15.146:0/2853732502 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c032440 con 0x7fa19c159ca0 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa19a000640 1 -- 172.21.15.146:0/2853732502 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c032820 con 0x7fa19c159ca0 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa1a1000640 1 -- 172.21.15.146:0/2853732502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c159ca0 msgr2=0x7fa19c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.206+0000 7fa1a1000640 1 --2- 172.21.15.146:0/2853732502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c159ca0 0x7fa19c0ca360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009910 tx=0x7fa18c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.207+0000 7fa1a1000640 1 -- 172.21.15.146:0/2853732502 shutdown_connections 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.207+0000 7fa1a1000640 1 --2- 172.21.15.146:0/2853732502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c159ca0 0x7fa19c0ca360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.207+0000 7fa1a1000640 1 -- 172.21.15.146:0/2853732502 >> 172.21.15.146:0/2853732502 conn(0x7fa19c098e00 msgr2=0x7fa19c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.207+0000 7fa1a1000640 1 -- 172.21.15.146:0/2853732502 shutdown_connections 2024-08-17T02:26:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.207+0000 7fa1a1000640 1 -- 172.21.15.146:0/2853732502 wait complete. 2024-08-17T02:26:57.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.208+0000 7fa1a1000640 1 Processor -- start 2024-08-17T02:26:57.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.208+0000 7fa1a1000640 1 -- start start 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa19c0ccca0 0x7fa19c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa19c159ca0 0x7fa19c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0c7b40 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c169cf0 con 0x7fa19c159ca0 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa1a1000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0c6f30 con 0x7fa19c0ccca0 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa19b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa19b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39678/0 (socket says 172.21.15.146:39678) 2024-08-17T02:26:57.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.209+0000 7fa19b400640 1 -- 172.21.15.146:0/163412946 learned_addr learned my addr 172.21.15.146:0/163412946 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19aa00640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa19c0ccca0 0x7fa19c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19be00640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa19c159ca0 0x7fa19c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 -- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa19c0ccca0 msgr2=0x7fa19c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa19c0ccca0 0x7fa19c1547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 -- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa19c159ca0 msgr2=0x7fa19c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa19c159ca0 0x7fa19c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 -- 172.21.15.146:0/163412946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009450 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa19b400640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa18c035040 tx=0x7fa18c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c031a60 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c031be0 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c046430 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.210+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c0c7210 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.211+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0c77d0 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.212+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c071050 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.212+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa18c039040 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.213+0000 7fa192a00640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 0x7fa17c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.213+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa18c041030 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.213+0000 7fa19aa00640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 0x7fa17c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.214+0000 7fa19aa00640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 0x7fa17c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0c5180 tx=0x7fa188007c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.217+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa18c071260 con 0x7fa19c0ca8a0 2024-08-17T02:26:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.394+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa19c0c7c80 con 0x7fa17c065150 2024-08-17T02:26:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.402+0000 7fa192a00640 1 -- 172.21.15.146:0/163412946 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288705 (secure 0 0 0) 0x7fa188007320 con 0x7fa17c065150 2024-08-17T02:26:57.406 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:57.407 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.406+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 msgr2=0x7fa17c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.406+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 0x7fa17c067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0c5180 tx=0x7fa188007c40 comp rx=0 tx=0).stop 2024-08-17T02:26:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 msgr2=0x7fa19c0c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa18c035040 tx=0x7fa18c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 shutdown_connections 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa17c065150 0x7fa17c067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa19c159ca0 0x7fa19c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa19c0ccca0 0x7fa19c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 --2- 172.21.15.146:0/163412946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa19c0ca8a0 0x7fa19c0c6120 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 >> 172.21.15.146:0/163412946 conn(0x7fa19c098e00 msgr2=0x7fa19c156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 shutdown_connections 2024-08-17T02:26:57.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.407+0000 7fa1a1000640 1 -- 172.21.15.146:0/163412946 wait complete. 2024-08-17T02:26:57.422 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:26:56.333588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382912,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591808,"statfs":{"total":773094113280,"available":770654011392,"internally_reserved":0,"allocated":4136960,"data_stored":2306444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091331"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277334+0000","last_change":"2024-08-17T02:26:53.273917+0000","last_active":"2024-08-17T02:26:53.277334+0000","last_peered":"2024-08-17T02:26:53.277334+0000","last_clean":"2024-08-17T02:26:53.277334+0000","last_became_active":"2024-08-17T02:26:53.273631+0000","last_became_peered":"2024-08-17T02:26:53.273631+0000","last_unstale":"2024-08-17T02:26:53.277334+0000","last_undegraded":"2024-08-17T02:26:53.277334+0000","last_fullsized":"2024-08-17T02:26:53.277334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.293318+0000","last_change":"2024-08-17T02:26:53.292328+0000","last_active":"2024-08-17T02:26:53.293318+0000","last_peered":"2024-08-17T02:26:53.293318+0000","last_clean":"2024-08-17T02:26:53.293318+0000","last_became_active":"2024-08-17T02:26:53.291993+0000","last_became_peered":"2024-08-17T02:26:53.291993+0000","last_unstale":"2024-08-17T02:26:53.293318+0000","last_undegraded":"2024-08-17T02:26:53.293318+0000","last_fullsized":"2024-08-17T02:26:53.293318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:27.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295399+0000","last_change":"2024-08-17T02:26:53.291598+0000","last_active":"2024-08-17T02:26:53.295399+0000","last_peered":"2024-08-17T02:26:53.295399+0000","last_clean":"2024-08-17T02:26:53.295399+0000","last_became_active":"2024-08-17T02:26:53.291103+0000","last_became_peered":"2024-08-17T02:26:53.291103+0000","last_unstale":"2024-08-17T02:26:53.295399+0000","last_undegraded":"2024-08-17T02:26:53.295399+0000","last_fullsized":"2024-08-17T02:26:53.295399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:55.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289871+0000","last_change":"2024-08-17T02:26:53.286746+0000","last_active":"2024-08-17T02:26:53.289871+0000","last_peered":"2024-08-17T02:26:53.289871+0000","last_clean":"2024-08-17T02:26:53.289871+0000","last_became_active":"2024-08-17T02:26:53.286336+0000","last_became_peered":"2024-08-17T02:26:53.286336+0000","last_unstale":"2024-08-17T02:26:53.289871+0000","last_undegraded":"2024-08-17T02:26:53.289871+0000","last_fullsized":"2024-08-17T02:26:53.289871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:00.025355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.274905+0000","last_change":"2024-08-17T02:26:53.272305+0000","last_active":"2024-08-17T02:26:53.274905+0000","last_peered":"2024-08-17T02:26:53.274905+0000","last_clean":"2024-08-17T02:26:53.274905+0000","last_became_active":"2024-08-17T02:26:53.271950+0000","last_became_peered":"2024-08-17T02:26:53.271950+0000","last_unstale":"2024-08-17T02:26:53.274905+0000","last_undegraded":"2024-08-17T02:26:53.274905+0000","last_fullsized":"2024-08-17T02:26:53.274905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:32.426380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279594+0000","last_change":"2024-08-17T02:26:53.271973+0000","last_active":"2024-08-17T02:26:53.279594+0000","last_peered":"2024-08-17T02:26:53.279594+0000","last_clean":"2024-08-17T02:26:53.279594+0000","last_became_active":"2024-08-17T02:26:53.271721+0000","last_became_peered":"2024-08-17T02:26:53.271721+0000","last_unstale":"2024-08-17T02:26:53.279594+0000","last_undegraded":"2024-08-17T02:26:53.279594+0000","last_fullsized":"2024-08-17T02:26:53.279594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:20.942203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275853+0000","last_change":"2024-08-17T02:26:53.272925+0000","last_active":"2024-08-17T02:26:53.275853+0000","last_peered":"2024-08-17T02:26:53.275853+0000","last_clean":"2024-08-17T02:26:53.275853+0000","last_became_active":"2024-08-17T02:26:53.271806+0000","last_became_peered":"2024-08-17T02:26:53.271806+0000","last_unstale":"2024-08-17T02:26:53.275853+0000","last_undegraded":"2024-08-17T02:26:53.275853+0000","last_fullsized":"2024-08-17T02:26:53.275853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287138+0000","last_change":"2024-08-17T02:26:53.282701+0000","last_active":"2024-08-17T02:26:53.287138+0000","last_peered":"2024-08-17T02:26:53.287138+0000","last_clean":"2024-08-17T02:26:53.287138+0000","last_became_active":"2024-08-17T02:26:53.282444+0000","last_became_peered":"2024-08-17T02:26:53.282444+0000","last_unstale":"2024-08-17T02:26:53.287138+0000","last_undegraded":"2024-08-17T02:26:53.287138+0000","last_fullsized":"2024-08-17T02:26:53.287138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288922+0000","last_change":"2024-08-17T02:26:53.286305+0000","last_active":"2024-08-17T02:26:53.288922+0000","last_peered":"2024-08-17T02:26:53.288922+0000","last_clean":"2024-08-17T02:26:53.288922+0000","last_became_active":"2024-08-17T02:26:53.286017+0000","last_became_peered":"2024-08-17T02:26:53.286017+0000","last_unstale":"2024-08-17T02:26:53.288922+0000","last_undegraded":"2024-08-17T02:26:53.288922+0000","last_fullsized":"2024-08-17T02:26:53.288922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278252+0000","last_change":"2024-08-17T02:26:53.272708+0000","last_active":"2024-08-17T02:26:53.278252+0000","last_peered":"2024-08-17T02:26:53.278252+0000","last_clean":"2024-08-17T02:26:53.278252+0000","last_became_active":"2024-08-17T02:26:53.270723+0000","last_became_peered":"2024-08-17T02:26:53.270723+0000","last_unstale":"2024-08-17T02:26:53.278252+0000","last_undegraded":"2024-08-17T02:26:53.278252+0000","last_fullsized":"2024-08-17T02:26:53.278252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.272023+0000","last_change":"2024-08-17T02:26:53.269509+0000","last_active":"2024-08-17T02:26:53.272023+0000","last_peered":"2024-08-17T02:26:53.272023+0000","last_clean":"2024-08-17T02:26:53.272023+0000","last_became_active":"2024-08-17T02:26:53.269215+0000","last_became_peered":"2024-08-17T02:26:53.269215+0000","last_unstale":"2024-08-17T02:26:53.272023+0000","last_undegraded":"2024-08-17T02:26:53.272023+0000","last_fullsized":"2024-08-17T02:26:53.272023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:00.025355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287947+0000","last_change":"2024-08-17T02:26:53.280978+0000","last_active":"2024-08-17T02:26:53.287947+0000","last_peered":"2024-08-17T02:26:53.287947+0000","last_clean":"2024-08-17T02:26:53.287947+0000","last_became_active":"2024-08-17T02:26:53.280702+0000","last_became_peered":"2024-08-17T02:26:53.280702+0000","last_unstale":"2024-08-17T02:26:53.287947+0000","last_undegraded":"2024-08-17T02:26:53.287947+0000","last_fullsized":"2024-08-17T02:26:53.287947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:27.055938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289928+0000","last_change":"2024-08-17T02:26:53.286804+0000","last_active":"2024-08-17T02:26:53.289928+0000","last_peered":"2024-08-17T02:26:53.289928+0000","last_clean":"2024-08-17T02:26:53.289928+0000","last_became_active":"2024-08-17T02:26:53.286026+0000","last_became_peered":"2024-08-17T02:26:53.286026+0000","last_unstale":"2024-08-17T02:26:53.289928+0000","last_undegraded":"2024-08-17T02:26:53.289928+0000","last_fullsized":"2024-08-17T02:26:53.289928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.355057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279576+0000","last_change":"2024-08-17T02:26:53.271584+0000","last_active":"2024-08-17T02:26:53.279576+0000","last_peered":"2024-08-17T02:26:53.279576+0000","last_clean":"2024-08-17T02:26:53.279576+0000","last_became_active":"2024-08-17T02:26:53.271309+0000","last_became_peered":"2024-08-17T02:26:53.271309+0000","last_unstale":"2024-08-17T02:26:53.279576+0000","last_undegraded":"2024-08-17T02:26:53.279576+0000","last_fullsized":"2024-08-17T02:26:53.279576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:55.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283659+0000","last_change":"2024-08-17T02:26:53.278246+0000","last_active":"2024-08-17T02:26:53.283659+0000","last_peered":"2024-08-17T02:26:53.283659+0000","last_clean":"2024-08-17T02:26:53.283659+0000","last_became_active":"2024-08-17T02:26:53.277664+0000","last_became_peered":"2024-08-17T02:26:53.277664+0000","last_unstale":"2024-08-17T02:26:53.283659+0000","last_undegraded":"2024-08-17T02:26:53.283659+0000","last_fullsized":"2024-08-17T02:26:53.283659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267028+0000","last_change":"2024-08-17T02:26:53.263731+0000","last_active":"2024-08-17T02:26:53.267028+0000","last_peered":"2024-08-17T02:26:53.267028+0000","last_clean":"2024-08-17T02:26:53.267028+0000","last_became_active":"2024-08-17T02:26:53.263425+0000","last_became_peered":"2024-08-17T02:26:53.263425+0000","last_unstale":"2024-08-17T02:26:53.267028+0000","last_undegraded":"2024-08-17T02:26:53.267028+0000","last_fullsized":"2024-08-17T02:26:53.267028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:46.299279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278009+0000","last_change":"2024-08-17T02:26:53.276420+0000","last_active":"2024-08-17T02:26:53.278009+0000","last_peered":"2024-08-17T02:26:53.278009+0000","last_clean":"2024-08-17T02:26:53.278009+0000","last_became_active":"2024-08-17T02:26:53.275780+0000","last_became_peered":"2024-08-17T02:26:53.275780+0000","last_unstale":"2024-08-17T02:26:53.278009+0000","last_undegraded":"2024-08-17T02:26:53.278009+0000","last_fullsized":"2024-08-17T02:26:53.278009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270329+0000","last_change":"2024-08-17T02:26:53.267904+0000","last_active":"2024-08-17T02:26:53.270329+0000","last_peered":"2024-08-17T02:26:53.270329+0000","last_clean":"2024-08-17T02:26:53.270329+0000","last_became_active":"2024-08-17T02:26:53.267624+0000","last_became_peered":"2024-08-17T02:26:53.267624+0000","last_unstale":"2024-08-17T02:26:53.270329+0000","last_undegraded":"2024-08-17T02:26:53.270329+0000","last_fullsized":"2024-08-17T02:26:53.270329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:10:12.369580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279544+0000","last_change":"2024-08-17T02:26:53.271463+0000","last_active":"2024-08-17T02:26:53.279544+0000","last_peered":"2024-08-17T02:26:53.279544+0000","last_clean":"2024-08-17T02:26:53.279544+0000","last_became_active":"2024-08-17T02:26:53.270147+0000","last_became_peered":"2024-08-17T02:26:53.270147+0000","last_unstale":"2024-08-17T02:26:53.279544+0000","last_undegraded":"2024-08-17T02:26:53.279544+0000","last_fullsized":"2024-08-17T02:26:53.279544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:31:49.034807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285598+0000","last_change":"2024-08-17T02:26:53.279222+0000","last_active":"2024-08-17T02:26:53.285598+0000","last_peered":"2024-08-17T02:26:53.285598+0000","last_clean":"2024-08-17T02:26:53.285598+0000","last_became_active":"2024-08-17T02:26:53.278893+0000","last_became_peered":"2024-08-17T02:26:53.278893+0000","last_unstale":"2024-08-17T02:26:53.285598+0000","last_undegraded":"2024-08-17T02:26:53.285598+0000","last_fullsized":"2024-08-17T02:26:53.285598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288693+0000","last_change":"2024-08-17T02:26:53.282214+0000","last_active":"2024-08-17T02:26:53.288693+0000","last_peered":"2024-08-17T02:26:53.288693+0000","last_clean":"2024-08-17T02:26:53.288693+0000","last_became_active":"2024-08-17T02:26:53.281953+0000","last_became_peered":"2024-08-17T02:26:53.281953+0000","last_unstale":"2024-08-17T02:26:53.288693+0000","last_undegraded":"2024-08-17T02:26:53.288693+0000","last_fullsized":"2024-08-17T02:26:53.288693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:32.547394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283694+0000","last_change":"2024-08-17T02:26:53.277313+0000","last_active":"2024-08-17T02:26:53.283694+0000","last_peered":"2024-08-17T02:26:53.283694+0000","last_clean":"2024-08-17T02:26:53.283694+0000","last_became_active":"2024-08-17T02:26:53.277002+0000","last_became_peered":"2024-08-17T02:26:53.277002+0000","last_unstale":"2024-08-17T02:26:53.283694+0000","last_undegraded":"2024-08-17T02:26:53.283694+0000","last_fullsized":"2024-08-17T02:26:53.283694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.290824+0000","last_change":"2024-08-17T02:26:53.273088+0000","last_active":"2024-08-17T02:26:53.290824+0000","last_peered":"2024-08-17T02:26:53.290824+0000","last_clean":"2024-08-17T02:26:53.290824+0000","last_became_active":"2024-08-17T02:26:53.272704+0000","last_became_peered":"2024-08-17T02:26:53.272704+0000","last_unstale":"2024-08-17T02:26:53.290824+0000","last_undegraded":"2024-08-17T02:26:53.290824+0000","last_fullsized":"2024-08-17T02:26:53.290824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288393+0000","last_change":"2024-08-17T02:26:53.285196+0000","last_active":"2024-08-17T02:26:53.288393+0000","last_peered":"2024-08-17T02:26:53.288393+0000","last_clean":"2024-08-17T02:26:53.288393+0000","last_became_active":"2024-08-17T02:26:53.283804+0000","last_became_peered":"2024-08-17T02:26:53.283804+0000","last_unstale":"2024-08-17T02:26:53.288393+0000","last_undegraded":"2024-08-17T02:26:53.288393+0000","last_fullsized":"2024-08-17T02:26:53.288393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285698+0000","last_change":"2024-08-17T02:26:53.276957+0000","last_active":"2024-08-17T02:26:53.285698+0000","last_peered":"2024-08-17T02:26:53.285698+0000","last_clean":"2024-08-17T02:26:53.285698+0000","last_became_active":"2024-08-17T02:26:53.276619+0000","last_became_peered":"2024-08-17T02:26:53.276619+0000","last_unstale":"2024-08-17T02:26:53.285698+0000","last_undegraded":"2024-08-17T02:26:53.285698+0000","last_fullsized":"2024-08-17T02:26:53.285698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267321+0000","last_change":"2024-08-17T02:26:53.262315+0000","last_active":"2024-08-17T02:26:53.267321+0000","last_peered":"2024-08-17T02:26:53.267321+0000","last_clean":"2024-08-17T02:26:53.267321+0000","last_became_active":"2024-08-17T02:26:53.262066+0000","last_became_peered":"2024-08-17T02:26:53.262066+0000","last_unstale":"2024-08-17T02:26:53.267321+0000","last_undegraded":"2024-08-17T02:26:53.267321+0000","last_fullsized":"2024-08-17T02:26:53.267321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:09.536981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295586+0000","last_change":"2024-08-17T02:26:53.289537+0000","last_active":"2024-08-17T02:26:53.295586+0000","last_peered":"2024-08-17T02:26:53.295586+0000","last_clean":"2024-08-17T02:26:53.295586+0000","last_became_active":"2024-08-17T02:26:53.288810+0000","last_became_peered":"2024-08-17T02:26:53.288810+0000","last_unstale":"2024-08-17T02:26:53.295586+0000","last_undegraded":"2024-08-17T02:26:53.295586+0000","last_fullsized":"2024-08-17T02:26:53.295586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277921+0000","last_change":"2024-08-17T02:26:53.274291+0000","last_active":"2024-08-17T02:26:53.277921+0000","last_peered":"2024-08-17T02:26:53.277921+0000","last_clean":"2024-08-17T02:26:53.277921+0000","last_became_active":"2024-08-17T02:26:53.274010+0000","last_became_peered":"2024-08-17T02:26:53.274010+0000","last_unstale":"2024-08-17T02:26:53.277921+0000","last_undegraded":"2024-08-17T02:26:53.277921+0000","last_fullsized":"2024-08-17T02:26:53.277921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:06.350384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288730+0000","last_change":"2024-08-17T02:26:53.282907+0000","last_active":"2024-08-17T02:26:53.288730+0000","last_peered":"2024-08-17T02:26:53.288730+0000","last_clean":"2024-08-17T02:26:53.288730+0000","last_became_active":"2024-08-17T02:26:53.277778+0000","last_became_peered":"2024-08-17T02:26:53.277778+0000","last_unstale":"2024-08-17T02:26:53.288730+0000","last_undegraded":"2024-08-17T02:26:53.288730+0000","last_fullsized":"2024-08-17T02:26:53.288730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277869+0000","last_change":"2024-08-17T02:26:53.276151+0000","last_active":"2024-08-17T02:26:53.277869+0000","last_peered":"2024-08-17T02:26:53.277869+0000","last_clean":"2024-08-17T02:26:53.277869+0000","last_became_active":"2024-08-17T02:26:53.275443+0000","last_became_peered":"2024-08-17T02:26:53.275443+0000","last_unstale":"2024-08-17T02:26:53.277869+0000","last_undegraded":"2024-08-17T02:26:53.277869+0000","last_fullsized":"2024-08-17T02:26:53.277869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:14:40.675935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.281513+0000","last_change":"2024-08-17T02:26:53.278830+0000","last_active":"2024-08-17T02:26:53.281513+0000","last_peered":"2024-08-17T02:26:53.281513+0000","last_clean":"2024-08-17T02:26:53.281513+0000","last_became_active":"2024-08-17T02:26:53.275449+0000","last_became_peered":"2024-08-17T02:26:53.275449+0000","last_unstale":"2024-08-17T02:26:53.281513+0000","last_undegraded":"2024-08-17T02:26:53.281513+0000","last_fullsized":"2024-08-17T02:26:53.281513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:32.426380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288312+0000","last_change":"2024-08-17T02:26:53.285455+0000","last_active":"2024-08-17T02:26:53.288312+0000","last_peered":"2024-08-17T02:26:53.288312+0000","last_clean":"2024-08-17T02:26:53.288312+0000","last_became_active":"2024-08-17T02:26:53.285098+0000","last_became_peered":"2024-08-17T02:26:53.285098+0000","last_unstale":"2024-08-17T02:26:53.288312+0000","last_undegraded":"2024-08-17T02:26:53.288312+0000","last_fullsized":"2024-08-17T02:26:53.288312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:55.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286586+0000","last_change":"2024-08-17T02:26:53.272249+0000","last_active":"2024-08-17T02:26:53.286586+0000","last_peered":"2024-08-17T02:26:53.286586+0000","last_clean":"2024-08-17T02:26:53.286586+0000","last_became_active":"2024-08-17T02:26:53.271986+0000","last_became_peered":"2024-08-17T02:26:53.271986+0000","last_unstale":"2024-08-17T02:26:53.286586+0000","last_undegraded":"2024-08-17T02:26:53.286586+0000","last_fullsized":"2024-08-17T02:26:53.286586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296447+0000","last_change":"2024-08-17T02:26:52.273252+0000","last_active":"2024-08-17T02:26:53.296447+0000","last_peered":"2024-08-17T02:26:53.296447+0000","last_clean":"2024-08-17T02:26:53.296447+0000","last_became_active":"2024-08-17T02:26:52.272976+0000","last_became_peered":"2024-08-17T02:26:52.272976+0000","last_unstale":"2024-08-17T02:26:53.296447+0000","last_undegraded":"2024-08-17T02:26:53.296447+0000","last_fullsized":"2024-08-17T02:26:53.296447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287724+0000","last_change":"2024-08-17T02:26:53.286336+0000","last_active":"2024-08-17T02:26:53.287724+0000","last_peered":"2024-08-17T02:26:53.287724+0000","last_clean":"2024-08-17T02:26:53.287724+0000","last_became_active":"2024-08-17T02:26:53.285662+0000","last_became_peered":"2024-08-17T02:26:53.285662+0000","last_unstale":"2024-08-17T02:26:53.287724+0000","last_undegraded":"2024-08-17T02:26:53.287724+0000","last_fullsized":"2024-08-17T02:26:53.287724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294921+0000","last_change":"2024-08-17T02:26:52.274012+0000","last_active":"2024-08-17T02:26:53.294921+0000","last_peered":"2024-08-17T02:26:53.294921+0000","last_clean":"2024-08-17T02:26:53.294921+0000","last_became_active":"2024-08-17T02:26:52.273740+0000","last_became_peered":"2024-08-17T02:26:52.273740+0000","last_unstale":"2024-08-17T02:26:53.294921+0000","last_undegraded":"2024-08-17T02:26:53.294921+0000","last_fullsized":"2024-08-17T02:26:53.294921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.282410+0000","last_change":"2024-08-17T02:26:53.278406+0000","last_active":"2024-08-17T02:26:53.282410+0000","last_peered":"2024-08-17T02:26:53.282410+0000","last_clean":"2024-08-17T02:26:53.282410+0000","last_became_active":"2024-08-17T02:26:53.278085+0000","last_became_peered":"2024-08-17T02:26:53.278085+0000","last_unstale":"2024-08-17T02:26:53.282410+0000","last_undegraded":"2024-08-17T02:26:53.282410+0000","last_fullsized":"2024-08-17T02:26:53.282410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.301435+0000","last_change":"2024-08-17T02:26:52.270985+0000","last_active":"2024-08-17T02:26:53.301435+0000","last_peered":"2024-08-17T02:26:53.301435+0000","last_clean":"2024-08-17T02:26:53.301435+0000","last_became_active":"2024-08-17T02:26:52.270748+0000","last_became_peered":"2024-08-17T02:26:52.270748+0000","last_unstale":"2024-08-17T02:26:53.301435+0000","last_undegraded":"2024-08-17T02:26:53.301435+0000","last_fullsized":"2024-08-17T02:26:53.301435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:31.539920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295633+0000","last_change":"2024-08-17T02:26:53.290008+0000","last_active":"2024-08-17T02:26:53.295633+0000","last_peered":"2024-08-17T02:26:53.295633+0000","last_clean":"2024-08-17T02:26:53.295633+0000","last_became_active":"2024-08-17T02:26:53.289132+0000","last_became_peered":"2024-08-17T02:26:53.289132+0000","last_unstale":"2024-08-17T02:26:53.295633+0000","last_undegraded":"2024-08-17T02:26:53.295633+0000","last_fullsized":"2024-08-17T02:26:53.295633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.290418+0000","last_change":"2024-08-17T02:26:52.272490+0000","last_active":"2024-08-17T02:26:53.290418+0000","last_peered":"2024-08-17T02:26:53.290418+0000","last_clean":"2024-08-17T02:26:53.290418+0000","last_became_active":"2024-08-17T02:26:52.272248+0000","last_became_peered":"2024-08-17T02:26:52.272248+0000","last_unstale":"2024-08-17T02:26:53.290418+0000","last_undegraded":"2024-08-17T02:26:53.290418+0000","last_fullsized":"2024-08-17T02:26:53.290418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:19.443498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.284035+0000","last_change":"2024-08-17T02:26:53.280884+0000","last_active":"2024-08-17T02:26:53.284035+0000","last_peered":"2024-08-17T02:26:53.284035+0000","last_clean":"2024-08-17T02:26:53.284035+0000","last_became_active":"2024-08-17T02:26:53.279599+0000","last_became_peered":"2024-08-17T02:26:53.279599+0000","last_unstale":"2024-08-17T02:26:53.284035+0000","last_undegraded":"2024-08-17T02:26:53.284035+0000","last_fullsized":"2024-08-17T02:26:53.284035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:06.350384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.298908+0000","last_change":"2024-08-17T02:26:52.275961+0000","last_active":"2024-08-17T02:26:53.298908+0000","last_peered":"2024-08-17T02:26:53.298908+0000","last_clean":"2024-08-17T02:26:53.298908+0000","last_became_active":"2024-08-17T02:26:52.275393+0000","last_became_peered":"2024-08-17T02:26:52.275393+0000","last_unstale":"2024-08-17T02:26:53.298908+0000","last_undegraded":"2024-08-17T02:26:53.298908+0000","last_fullsized":"2024-08-17T02:26:53.298908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283637+0000","last_change":"2024-08-17T02:26:53.278734+0000","last_active":"2024-08-17T02:26:53.283637+0000","last_peered":"2024-08-17T02:26:53.283637+0000","last_clean":"2024-08-17T02:26:53.283637+0000","last_became_active":"2024-08-17T02:26:53.278422+0000","last_became_peered":"2024-08-17T02:26:53.278422+0000","last_unstale":"2024-08-17T02:26:53.283637+0000","last_undegraded":"2024-08-17T02:26:53.283637+0000","last_fullsized":"2024-08-17T02:26:53.283637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:38.783071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.299694+0000","last_change":"2024-08-17T02:26:52.275538+0000","last_active":"2024-08-17T02:26:53.299694+0000","last_peered":"2024-08-17T02:26:53.299694+0000","last_clean":"2024-08-17T02:26:53.299694+0000","last_became_active":"2024-08-17T02:26:52.275223+0000","last_became_peered":"2024-08-17T02:26:52.275223+0000","last_unstale":"2024-08-17T02:26:53.299694+0000","last_undegraded":"2024-08-17T02:26:53.299694+0000","last_fullsized":"2024-08-17T02:26:53.299694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:24:37.615112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.281989+0000","last_change":"2024-08-17T02:26:53.275227+0000","last_active":"2024-08-17T02:26:53.281989+0000","last_peered":"2024-08-17T02:26:53.281989+0000","last_clean":"2024-08-17T02:26:53.281989+0000","last_became_active":"2024-08-17T02:26:53.274938+0000","last_became_peered":"2024-08-17T02:26:53.274938+0000","last_unstale":"2024-08-17T02:26:53.281989+0000","last_undegraded":"2024-08-17T02:26:53.281989+0000","last_fullsized":"2024-08-17T02:26:53.281989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.256035+0000","last_change":"2024-08-17T02:26:52.267821+0000","last_active":"2024-08-17T02:26:53.256035+0000","last_peered":"2024-08-17T02:26:53.256035+0000","last_clean":"2024-08-17T02:26:53.256035+0000","last_became_active":"2024-08-17T02:26:52.267549+0000","last_became_peered":"2024-08-17T02:26:52.267549+0000","last_unstale":"2024-08-17T02:26:53.256035+0000","last_undegraded":"2024-08-17T02:26:53.256035+0000","last_fullsized":"2024-08-17T02:26:53.256035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:06.797876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289236+0000","last_change":"2024-08-17T02:26:53.283246+0000","last_active":"2024-08-17T02:26:53.289236+0000","last_peered":"2024-08-17T02:26:53.289236+0000","last_clean":"2024-08-17T02:26:53.289236+0000","last_became_active":"2024-08-17T02:26:53.282997+0000","last_became_peered":"2024-08-17T02:26:53.282997+0000","last_unstale":"2024-08-17T02:26:53.289236+0000","last_undegraded":"2024-08-17T02:26:53.289236+0000","last_fullsized":"2024-08-17T02:26:53.289236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:15.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270108+0000","last_change":"2024-08-17T02:26:52.274989+0000","last_active":"2024-08-17T02:26:53.270108+0000","last_peered":"2024-08-17T02:26:53.270108+0000","last_clean":"2024-08-17T02:26:53.270108+0000","last_became_active":"2024-08-17T02:26:52.274250+0000","last_became_peered":"2024-08-17T02:26:52.274250+0000","last_unstale":"2024-08-17T02:26:53.270108+0000","last_undegraded":"2024-08-17T02:26:53.270108+0000","last_fullsized":"2024-08-17T02:26:53.270108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:28.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283499+0000","last_change":"2024-08-17T02:26:53.279839+0000","last_active":"2024-08-17T02:26:53.283499+0000","last_peered":"2024-08-17T02:26:53.283499+0000","last_clean":"2024-08-17T02:26:53.283499+0000","last_became_active":"2024-08-17T02:26:53.279579+0000","last_became_peered":"2024-08-17T02:26:53.279579+0000","last_unstale":"2024-08-17T02:26:53.283499+0000","last_undegraded":"2024-08-17T02:26:53.283499+0000","last_fullsized":"2024-08-17T02:26:53.283499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:14:40.675935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.257044+0000","last_change":"2024-08-17T02:26:52.273996+0000","last_active":"2024-08-17T02:26:53.257044+0000","last_peered":"2024-08-17T02:26:53.257044+0000","last_clean":"2024-08-17T02:26:53.257044+0000","last_became_active":"2024-08-17T02:26:52.273750+0000","last_became_peered":"2024-08-17T02:26:52.273750+0000","last_unstale":"2024-08-17T02:26:53.257044+0000","last_undegraded":"2024-08-17T02:26:53.257044+0000","last_fullsized":"2024-08-17T02:26:53.257044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:26.530417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286551+0000","last_change":"2024-08-17T02:26:53.279908+0000","last_active":"2024-08-17T02:26:53.286551+0000","last_peered":"2024-08-17T02:26:53.286551+0000","last_clean":"2024-08-17T02:26:53.286551+0000","last_became_active":"2024-08-17T02:26:53.278733+0000","last_became_peered":"2024-08-17T02:26:53.278733+0000","last_unstale":"2024-08-17T02:26:53.286551+0000","last_undegraded":"2024-08-17T02:26:53.286551+0000","last_fullsized":"2024-08-17T02:26:53.286551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:53:58.022226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292513+0000","last_change":"2024-08-17T02:26:52.271725+0000","last_active":"2024-08-17T02:26:53.292513+0000","last_peered":"2024-08-17T02:26:53.292513+0000","last_clean":"2024-08-17T02:26:53.292513+0000","last_became_active":"2024-08-17T02:26:52.270994+0000","last_became_peered":"2024-08-17T02:26:52.270994+0000","last_unstale":"2024-08-17T02:26:53.292513+0000","last_undegraded":"2024-08-17T02:26:53.292513+0000","last_fullsized":"2024-08-17T02:26:53.292513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267536+0000","last_change":"2024-08-17T02:26:53.263720+0000","last_active":"2024-08-17T02:26:53.267536+0000","last_peered":"2024-08-17T02:26:53.267536+0000","last_clean":"2024-08-17T02:26:53.267536+0000","last_became_active":"2024-08-17T02:26:53.261127+0000","last_became_peered":"2024-08-17T02:26:53.261127+0000","last_unstale":"2024-08-17T02:26:53.267536+0000","last_undegraded":"2024-08-17T02:26:53.267536+0000","last_fullsized":"2024-08-17T02:26:53.267536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:27.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288605+0000","last_change":"2024-08-17T02:26:52.277066+0000","last_active":"2024-08-17T02:26:53.288605+0000","last_peered":"2024-08-17T02:26:53.288605+0000","last_clean":"2024-08-17T02:26:53.288605+0000","last_became_active":"2024-08-17T02:26:52.276481+0000","last_became_peered":"2024-08-17T02:26:52.276481+0000","last_unstale":"2024-08-17T02:26:53.288605+0000","last_undegraded":"2024-08-17T02:26:53.288605+0000","last_fullsized":"2024-08-17T02:26:53.288605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:01.347583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292533+0000","last_change":"2024-08-17T02:26:53.288323+0000","last_active":"2024-08-17T02:26:53.292533+0000","last_peered":"2024-08-17T02:26:53.292533+0000","last_clean":"2024-08-17T02:26:53.292533+0000","last_became_active":"2024-08-17T02:26:53.287210+0000","last_became_peered":"2024-08-17T02:26:53.287210+0000","last_unstale":"2024-08-17T02:26:53.292533+0000","last_undegraded":"2024-08-17T02:26:53.292533+0000","last_fullsized":"2024-08-17T02:26:53.292533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:13.671034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.303962+0000","last_change":"2024-08-17T02:26:52.275603+0000","last_active":"2024-08-17T02:26:53.303962+0000","last_peered":"2024-08-17T02:26:53.303962+0000","last_clean":"2024-08-17T02:26:53.303962+0000","last_became_active":"2024-08-17T02:26:52.275282+0000","last_became_peered":"2024-08-17T02:26:52.275282+0000","last_unstale":"2024-08-17T02:26:53.303962+0000","last_undegraded":"2024-08-17T02:26:53.303962+0000","last_fullsized":"2024-08-17T02:26:53.303962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:14.784981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295475+0000","last_change":"2024-08-17T02:26:53.287634+0000","last_active":"2024-08-17T02:26:53.295475+0000","last_peered":"2024-08-17T02:26:53.295475+0000","last_clean":"2024-08-17T02:26:53.295475+0000","last_became_active":"2024-08-17T02:26:53.287375+0000","last_became_peered":"2024-08-17T02:26:53.287375+0000","last_unstale":"2024-08-17T02:26:53.295475+0000","last_undegraded":"2024-08-17T02:26:53.295475+0000","last_fullsized":"2024-08-17T02:26:53.295475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:32.547394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296905+0000","last_change":"2024-08-17T02:26:52.271816+0000","last_active":"2024-08-17T02:26:53.296905+0000","last_peered":"2024-08-17T02:26:53.296905+0000","last_clean":"2024-08-17T02:26:53.296905+0000","last_became_active":"2024-08-17T02:26:52.269593+0000","last_became_peered":"2024-08-17T02:26:52.269593+0000","last_unstale":"2024-08-17T02:26:53.296905+0000","last_undegraded":"2024-08-17T02:26:53.296905+0000","last_fullsized":"2024-08-17T02:26:53.296905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:09.296896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292352+0000","last_change":"2024-08-17T02:26:53.283303+0000","last_active":"2024-08-17T02:26:53.292352+0000","last_peered":"2024-08-17T02:26:53.292352+0000","last_clean":"2024-08-17T02:26:53.292352+0000","last_became_active":"2024-08-17T02:26:53.282987+0000","last_became_peered":"2024-08-17T02:26:53.282987+0000","last_unstale":"2024-08-17T02:26:53.292352+0000","last_undegraded":"2024-08-17T02:26:53.292352+0000","last_fullsized":"2024-08-17T02:26:53.292352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:04:24.222355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.262819+0000","last_change":"2024-08-17T02:26:52.267166+0000","last_active":"2024-08-17T02:26:53.262819+0000","last_peered":"2024-08-17T02:26:53.262819+0000","last_clean":"2024-08-17T02:26:53.262819+0000","last_became_active":"2024-08-17T02:26:52.266934+0000","last_became_peered":"2024-08-17T02:26:52.266934+0000","last_unstale":"2024-08-17T02:26:53.262819+0000","last_undegraded":"2024-08-17T02:26:53.262819+0000","last_fullsized":"2024-08-17T02:26:53.262819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:44.671728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288299+0000","last_change":"2024-08-17T02:26:53.285296+0000","last_active":"2024-08-17T02:26:53.288299+0000","last_peered":"2024-08-17T02:26:53.288299+0000","last_clean":"2024-08-17T02:26:53.288299+0000","last_became_active":"2024-08-17T02:26:53.284715+0000","last_became_peered":"2024-08-17T02:26:53.284715+0000","last_unstale":"2024-08-17T02:26:53.288299+0000","last_undegraded":"2024-08-17T02:26:53.288299+0000","last_fullsized":"2024-08-17T02:26:53.288299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:38.783071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.255894+0000","last_change":"2024-08-17T02:26:52.268036+0000","last_active":"2024-08-17T02:26:53.255894+0000","last_peered":"2024-08-17T02:26:53.255894+0000","last_clean":"2024-08-17T02:26:53.255894+0000","last_became_active":"2024-08-17T02:26:52.267787+0000","last_became_peered":"2024-08-17T02:26:52.267787+0000","last_unstale":"2024-08-17T02:26:53.255894+0000","last_undegraded":"2024-08-17T02:26:53.255894+0000","last_fullsized":"2024-08-17T02:26:53.255894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:53.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287696+0000","last_change":"2024-08-17T02:26:53.284299+0000","last_active":"2024-08-17T02:26:53.287696+0000","last_peered":"2024-08-17T02:26:53.287696+0000","last_clean":"2024-08-17T02:26:53.287696+0000","last_became_active":"2024-08-17T02:26:53.284026+0000","last_became_peered":"2024-08-17T02:26:53.284026+0000","last_unstale":"2024-08-17T02:26:53.287696+0000","last_undegraded":"2024-08-17T02:26:53.287696+0000","last_fullsized":"2024-08-17T02:26:53.287696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.302470+0000","last_change":"2024-08-17T02:26:52.269479+0000","last_active":"2024-08-17T02:26:53.302470+0000","last_peered":"2024-08-17T02:26:53.302470+0000","last_clean":"2024-08-17T02:26:53.302470+0000","last_became_active":"2024-08-17T02:26:52.269243+0000","last_became_peered":"2024-08-17T02:26:52.269243+0000","last_unstale":"2024-08-17T02:26:53.302470+0000","last_undegraded":"2024-08-17T02:26:53.302470+0000","last_fullsized":"2024-08-17T02:26:53.302470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:22.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283538+0000","last_change":"2024-08-17T02:26:53.279123+0000","last_active":"2024-08-17T02:26:53.283538+0000","last_peered":"2024-08-17T02:26:53.283538+0000","last_clean":"2024-08-17T02:26:53.283538+0000","last_became_active":"2024-08-17T02:26:53.278820+0000","last_became_peered":"2024-08-17T02:26:53.278820+0000","last_unstale":"2024-08-17T02:26:53.283538+0000","last_undegraded":"2024-08-17T02:26:53.283538+0000","last_fullsized":"2024-08-17T02:26:53.283538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.300474+0000","last_change":"2024-08-17T02:26:52.269641+0000","last_active":"2024-08-17T02:26:53.300474+0000","last_peered":"2024-08-17T02:26:53.300474+0000","last_clean":"2024-08-17T02:26:53.300474+0000","last_became_active":"2024-08-17T02:26:52.268732+0000","last_became_peered":"2024-08-17T02:26:52.268732+0000","last_unstale":"2024-08-17T02:26:53.300474+0000","last_undegraded":"2024-08-17T02:26:53.300474+0000","last_fullsized":"2024-08-17T02:26:53.300474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:14.569903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288339+0000","last_change":"2024-08-17T02:26:53.283428+0000","last_active":"2024-08-17T02:26:53.288339+0000","last_peered":"2024-08-17T02:26:53.288339+0000","last_clean":"2024-08-17T02:26:53.288339+0000","last_became_active":"2024-08-17T02:26:53.283157+0000","last_became_peered":"2024-08-17T02:26:53.283157+0000","last_unstale":"2024-08-17T02:26:53.288339+0000","last_undegraded":"2024-08-17T02:26:53.288339+0000","last_fullsized":"2024-08-17T02:26:53.288339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:55.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296895+0000","last_change":"2024-08-17T02:26:52.270472+0000","last_active":"2024-08-17T02:26:53.296895+0000","last_peered":"2024-08-17T02:26:53.296895+0000","last_clean":"2024-08-17T02:26:53.296895+0000","last_became_active":"2024-08-17T02:26:52.269871+0000","last_became_peered":"2024-08-17T02:26:52.269871+0000","last_unstale":"2024-08-17T02:26:53.296895+0000","last_undegraded":"2024-08-17T02:26:53.296895+0000","last_fullsized":"2024-08-17T02:26:53.296895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:29.158186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289850+0000","last_change":"2024-08-17T02:26:53.286615+0000","last_active":"2024-08-17T02:26:53.289850+0000","last_peered":"2024-08-17T02:26:53.289850+0000","last_clean":"2024-08-17T02:26:53.289850+0000","last_became_active":"2024-08-17T02:26:53.286030+0000","last_became_peered":"2024-08-17T02:26:53.286030+0000","last_unstale":"2024-08-17T02:26:53.289850+0000","last_undegraded":"2024-08-17T02:26:53.289850+0000","last_fullsized":"2024-08-17T02:26:53.289850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295486+0000","last_change":"2024-08-17T02:26:52.274282+0000","last_active":"2024-08-17T02:26:53.295486+0000","last_peered":"2024-08-17T02:26:53.295486+0000","last_clean":"2024-08-17T02:26:53.295486+0000","last_became_active":"2024-08-17T02:26:52.273991+0000","last_became_peered":"2024-08-17T02:26:52.273991+0000","last_unstale":"2024-08-17T02:26:53.295486+0000","last_undegraded":"2024-08-17T02:26:53.295486+0000","last_fullsized":"2024-08-17T02:26:53.295486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:58.751358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275763+0000","last_change":"2024-08-17T02:26:53.273470+0000","last_active":"2024-08-17T02:26:53.275763+0000","last_peered":"2024-08-17T02:26:53.275763+0000","last_clean":"2024-08-17T02:26:53.275763+0000","last_became_active":"2024-08-17T02:26:53.273227+0000","last_became_peered":"2024-08-17T02:26:53.273227+0000","last_unstale":"2024-08-17T02:26:53.275763+0000","last_undegraded":"2024-08-17T02:26:53.275763+0000","last_fullsized":"2024-08-17T02:26:53.275763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:29.582286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279081+0000","last_change":"2024-08-17T02:26:52.275542+0000","last_active":"2024-08-17T02:26:53.279081+0000","last_peered":"2024-08-17T02:26:53.279081+0000","last_clean":"2024-08-17T02:26:53.279081+0000","last_became_active":"2024-08-17T02:26:52.275217+0000","last_became_peered":"2024-08-17T02:26:52.275217+0000","last_unstale":"2024-08-17T02:26:53.279081+0000","last_undegraded":"2024-08-17T02:26:53.279081+0000","last_fullsized":"2024-08-17T02:26:53.279081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:40.494053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285741+0000","last_change":"2024-08-17T02:26:53.280287+0000","last_active":"2024-08-17T02:26:53.285741+0000","last_peered":"2024-08-17T02:26:53.285741+0000","last_clean":"2024-08-17T02:26:53.285741+0000","last_became_active":"2024-08-17T02:26:53.279960+0000","last_became_peered":"2024-08-17T02:26:53.279960+0000","last_unstale":"2024-08-17T02:26:53.285741+0000","last_undegraded":"2024-08-17T02:26:53.285741+0000","last_fullsized":"2024-08-17T02:26:53.285741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294681+0000","last_change":"2024-08-17T02:26:52.277108+0000","last_active":"2024-08-17T02:26:53.294681+0000","last_peered":"2024-08-17T02:26:53.294681+0000","last_clean":"2024-08-17T02:26:53.294681+0000","last_became_active":"2024-08-17T02:26:52.276859+0000","last_became_peered":"2024-08-17T02:26:52.276859+0000","last_unstale":"2024-08-17T02:26:53.294681+0000","last_undegraded":"2024-08-17T02:26:53.294681+0000","last_fullsized":"2024-08-17T02:26:53.294681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:44.671728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287341+0000","last_change":"2024-08-17T02:26:53.278545+0000","last_active":"2024-08-17T02:26:53.287341+0000","last_peered":"2024-08-17T02:26:53.287341+0000","last_clean":"2024-08-17T02:26:53.287341+0000","last_became_active":"2024-08-17T02:26:53.277951+0000","last_became_peered":"2024-08-17T02:26:53.277951+0000","last_unstale":"2024-08-17T02:26:53.287341+0000","last_undegraded":"2024-08-17T02:26:53.287341+0000","last_fullsized":"2024-08-17T02:26:53.287341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270670+0000","last_change":"2024-08-17T02:26:52.277367+0000","last_active":"2024-08-17T02:26:53.270670+0000","last_peered":"2024-08-17T02:26:53.270670+0000","last_clean":"2024-08-17T02:26:53.270670+0000","last_became_active":"2024-08-17T02:26:52.277106+0000","last_became_peered":"2024-08-17T02:26:52.277106+0000","last_unstale":"2024-08-17T02:26:53.270670+0000","last_undegraded":"2024-08-17T02:26:53.270670+0000","last_fullsized":"2024-08-17T02:26:53.270670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:29.158186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275389+0000","last_change":"2024-08-17T02:26:53.273947+0000","last_active":"2024-08-17T02:26:53.275389+0000","last_peered":"2024-08-17T02:26:53.275389+0000","last_clean":"2024-08-17T02:26:53.275389+0000","last_became_active":"2024-08-17T02:26:53.273719+0000","last_became_peered":"2024-08-17T02:26:53.273719+0000","last_unstale":"2024-08-17T02:26:53.275389+0000","last_undegraded":"2024-08-17T02:26:53.275389+0000","last_fullsized":"2024-08-17T02:26:53.275389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278310+0000","last_change":"2024-08-17T02:26:52.277711+0000","last_active":"2024-08-17T02:26:53.278310+0000","last_peered":"2024-08-17T02:26:53.278310+0000","last_clean":"2024-08-17T02:26:53.278310+0000","last_became_active":"2024-08-17T02:26:52.275841+0000","last_became_peered":"2024-08-17T02:26:52.275841+0000","last_unstale":"2024-08-17T02:26:53.278310+0000","last_undegraded":"2024-08-17T02:26:53.278310+0000","last_fullsized":"2024-08-17T02:26:53.278310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275872+0000","last_change":"2024-08-17T02:26:53.273296+0000","last_active":"2024-08-17T02:26:53.275872+0000","last_peered":"2024-08-17T02:26:53.275872+0000","last_clean":"2024-08-17T02:26:53.275872+0000","last_became_active":"2024-08-17T02:26:53.272164+0000","last_became_peered":"2024-08-17T02:26:53.272164+0000","last_unstale":"2024-08-17T02:26:53.275872+0000","last_undegraded":"2024-08-17T02:26:53.275872+0000","last_fullsized":"2024-08-17T02:26:53.275872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.268448+0000","last_change":"2024-08-17T02:26:52.276322+0000","last_active":"2024-08-17T02:26:53.268448+0000","last_peered":"2024-08-17T02:26:53.268448+0000","last_clean":"2024-08-17T02:26:53.268448+0000","last_became_active":"2024-08-17T02:26:52.276074+0000","last_became_peered":"2024-08-17T02:26:52.276074+0000","last_unstale":"2024-08-17T02:26:53.268448+0000","last_undegraded":"2024-08-17T02:26:53.268448+0000","last_fullsized":"2024-08-17T02:26:53.268448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.574812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285361+0000","last_change":"2024-08-17T02:26:53.279047+0000","last_active":"2024-08-17T02:26:53.285361+0000","last_peered":"2024-08-17T02:26:53.285361+0000","last_clean":"2024-08-17T02:26:53.285361+0000","last_became_active":"2024-08-17T02:26:53.278799+0000","last_became_peered":"2024-08-17T02:26:53.278799+0000","last_unstale":"2024-08-17T02:26:53.285361+0000","last_undegraded":"2024-08-17T02:26:53.285361+0000","last_fullsized":"2024-08-17T02:26:53.285361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.293331+0000","last_change":"2024-08-17T02:26:52.270525+0000","last_active":"2024-08-17T02:26:53.293331+0000","last_peered":"2024-08-17T02:26:53.293331+0000","last_clean":"2024-08-17T02:26:53.293331+0000","last_became_active":"2024-08-17T02:26:52.269962+0000","last_became_peered":"2024-08-17T02:26:52.269962+0000","last_unstale":"2024-08-17T02:26:53.293331+0000","last_undegraded":"2024-08-17T02:26:53.293331+0000","last_fullsized":"2024-08-17T02:26:53.293331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.297142+0000","last_change":"2024-08-17T02:26:53.296440+0000","last_active":"2024-08-17T02:26:53.297142+0000","last_peered":"2024-08-17T02:26:53.297142+0000","last_clean":"2024-08-17T02:26:53.297142+0000","last_became_active":"2024-08-17T02:26:53.296071+0000","last_became_peered":"2024-08-17T02:26:53.296071+0000","last_unstale":"2024-08-17T02:26:53.297142+0000","last_undegraded":"2024-08-17T02:26:53.297142+0000","last_fullsized":"2024-08-17T02:26:53.297142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:46.299279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286578+0000","last_change":"2024-08-17T02:26:52.276978+0000","last_active":"2024-08-17T02:26:53.286578+0000","last_peered":"2024-08-17T02:26:53.286578+0000","last_clean":"2024-08-17T02:26:53.286578+0000","last_became_active":"2024-08-17T02:26:52.276339+0000","last_became_peered":"2024-08-17T02:26:52.276339+0000","last_unstale":"2024-08-17T02:26:53.286578+0000","last_undegraded":"2024-08-17T02:26:53.286578+0000","last_fullsized":"2024-08-17T02:26:53.286578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:14.569903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.291065+0000","last_change":"2024-08-17T02:26:53.288898+0000","last_active":"2024-08-17T02:26:53.291065+0000","last_peered":"2024-08-17T02:26:53.291065+0000","last_clean":"2024-08-17T02:26:53.291065+0000","last_became_active":"2024-08-17T02:26:53.288619+0000","last_became_peered":"2024-08-17T02:26:53.288619+0000","last_unstale":"2024-08-17T02:26:53.291065+0000","last_undegraded":"2024-08-17T02:26:53.291065+0000","last_fullsized":"2024-08-17T02:26:53.291065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.264491+0000","last_change":"2024-08-17T02:26:52.271981+0000","last_active":"2024-08-17T02:26:53.264491+0000","last_peered":"2024-08-17T02:26:53.264491+0000","last_clean":"2024-08-17T02:26:53.264491+0000","last_became_active":"2024-08-17T02:26:52.267600+0000","last_became_peered":"2024-08-17T02:26:52.267600+0000","last_unstale":"2024-08-17T02:26:53.264491+0000","last_undegraded":"2024-08-17T02:26:53.264491+0000","last_fullsized":"2024-08-17T02:26:53.264491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:16:25.035021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295715+0000","last_change":"2024-08-17T02:26:53.291971+0000","last_active":"2024-08-17T02:26:53.295715+0000","last_peered":"2024-08-17T02:26:53.295715+0000","last_clean":"2024-08-17T02:26:53.295715+0000","last_became_active":"2024-08-17T02:26:53.291595+0000","last_became_peered":"2024-08-17T02:26:53.291595+0000","last_unstale":"2024-08-17T02:26:53.295715+0000","last_undegraded":"2024-08-17T02:26:53.295715+0000","last_fullsized":"2024-08-17T02:26:53.295715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.355057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277711+0000","last_change":"2024-08-17T02:26:52.273148+0000","last_active":"2024-08-17T02:26:53.277711+0000","last_peered":"2024-08-17T02:26:53.277711+0000","last_clean":"2024-08-17T02:26:53.277711+0000","last_became_active":"2024-08-17T02:26:52.272288+0000","last_became_peered":"2024-08-17T02:26:52.272288+0000","last_unstale":"2024-08-17T02:26:53.277711+0000","last_undegraded":"2024-08-17T02:26:53.277711+0000","last_fullsized":"2024-08-17T02:26:53.277711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:16:25.035021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294532+0000","last_change":"2024-08-17T02:26:53.281150+0000","last_active":"2024-08-17T02:26:53.294532+0000","last_peered":"2024-08-17T02:26:53.294532+0000","last_clean":"2024-08-17T02:26:53.294532+0000","last_became_active":"2024-08-17T02:26:53.280408+0000","last_became_peered":"2024-08-17T02:26:53.280408+0000","last_unstale":"2024-08-17T02:26:53.294532+0000","last_undegraded":"2024-08-17T02:26:53.294532+0000","last_fullsized":"2024-08-17T02:26:53.294532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.263935+0000","last_change":"2024-08-17T02:26:52.267147+0000","last_active":"2024-08-17T02:26:53.263935+0000","last_peered":"2024-08-17T02:26:53.263935+0000","last_clean":"2024-08-17T02:26:53.263935+0000","last_became_active":"2024-08-17T02:26:52.266997+0000","last_became_peered":"2024-08-17T02:26:52.266997+0000","last_unstale":"2024-08-17T02:26:53.263935+0000","last_undegraded":"2024-08-17T02:26:53.263935+0000","last_fullsized":"2024-08-17T02:26:53.263935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270506+0000","last_change":"2024-08-17T02:26:53.268276+0000","last_active":"2024-08-17T02:26:53.270506+0000","last_peered":"2024-08-17T02:26:53.270506+0000","last_clean":"2024-08-17T02:26:53.270506+0000","last_became_active":"2024-08-17T02:26:53.268041+0000","last_became_peered":"2024-08-17T02:26:53.268041+0000","last_unstale":"2024-08-17T02:26:53.270506+0000","last_undegraded":"2024-08-17T02:26:53.270506+0000","last_fullsized":"2024-08-17T02:26:53.270506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:13.671034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279035+0000","last_change":"2024-08-17T02:26:52.274077+0000","last_active":"2024-08-17T02:26:53.279035+0000","last_peered":"2024-08-17T02:26:53.279035+0000","last_clean":"2024-08-17T02:26:53.279035+0000","last_became_active":"2024-08-17T02:26:52.273819+0000","last_became_peered":"2024-08-17T02:26:52.273819+0000","last_unstale":"2024-08-17T02:26:53.279035+0000","last_undegraded":"2024-08-17T02:26:53.279035+0000","last_fullsized":"2024-08-17T02:26:53.279035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:19.443498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.282807+0000","last_change":"2024-08-17T02:26:53.272649+0000","last_active":"2024-08-17T02:26:53.282807+0000","last_peered":"2024-08-17T02:26:53.282807+0000","last_clean":"2024-08-17T02:26:53.282807+0000","last_became_active":"2024-08-17T02:26:53.272365+0000","last_became_peered":"2024-08-17T02:26:53.272365+0000","last_unstale":"2024-08-17T02:26:53.282807+0000","last_undegraded":"2024-08-17T02:26:53.282807+0000","last_fullsized":"2024-08-17T02:26:53.282807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:15.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.256608+0000","last_change":"2024-08-17T02:26:52.271621+0000","last_active":"2024-08-17T02:26:53.256608+0000","last_peered":"2024-08-17T02:26:53.256608+0000","last_clean":"2024-08-17T02:26:53.256608+0000","last_became_active":"2024-08-17T02:26:52.271331+0000","last_became_peered":"2024-08-17T02:26:52.271331+0000","last_unstale":"2024-08-17T02:26:53.256608+0000","last_undegraded":"2024-08-17T02:26:53.256608+0000","last_fullsized":"2024-08-17T02:26:53.256608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.314471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287087+0000","last_change":"2024-08-17T02:26:53.282257+0000","last_active":"2024-08-17T02:26:53.287087+0000","last_peered":"2024-08-17T02:26:53.287087+0000","last_clean":"2024-08-17T02:26:53.287087+0000","last_became_active":"2024-08-17T02:26:53.282005+0000","last_became_peered":"2024-08-17T02:26:53.282005+0000","last_unstale":"2024-08-17T02:26:53.287087+0000","last_undegraded":"2024-08-17T02:26:53.287087+0000","last_fullsized":"2024-08-17T02:26:53.287087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:27.055938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.265488+0000","last_change":"2024-08-17T02:26:52.269060+0000","last_active":"2024-08-17T02:26:53.265488+0000","last_peered":"2024-08-17T02:26:53.265488+0000","last_clean":"2024-08-17T02:26:53.265488+0000","last_became_active":"2024-08-17T02:26:52.268730+0000","last_became_peered":"2024-08-17T02:26:52.268730+0000","last_unstale":"2024-08-17T02:26:53.265488+0000","last_undegraded":"2024-08-17T02:26:53.265488+0000","last_fullsized":"2024-08-17T02:26:53.265488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.257066+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:53.257066+0000","last_peered":"2024-08-17T02:26:53.257066+0000","last_clean":"2024-08-17T02:26:53.257066+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:53.257066+0000","last_undegraded":"2024-08-17T02:26:53.257066+0000","last_fullsized":"2024-08-17T02:26:53.257066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":730587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71299999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.629},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.753},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.747},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.82799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.4660000000000002,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.44}]},{"osd":2,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.501},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.63}]},{"osd":4,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":3.6110000000000002,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":364544,"data_stored":140199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.314}]},{"osd":1,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.434}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.495},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.625}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":954368,"data_stored":730497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:57.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:57.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.611+0000 7f8cb6600640 1 Processor -- start 2024-08-17T02:26:57.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.611+0000 7f8cb6600640 1 -- start start 2024-08-17T02:26:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.612+0000 7f8cb6600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8cb00aa7d0 0x7f8cb006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.612+0000 7f8cb6600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb00a9a10 con 0x7f8cb006da20 2024-08-17T02:26:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.612+0000 7f8cb6600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb00a9cf0 con 0x7f8cb0158fa0 2024-08-17T02:26:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.612+0000 7f8cb6600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00ac400 con 0x7f8cb00aa7d0 2024-08-17T02:26:57.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8caf400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8cb006da20 0x7f8cb0158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49000/0 (socket says 172.21.15.146:49000) 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8caf400640 1 -- 172.21.15.146:0/1028831817 learned_addr learned my addr 172.21.15.146:0/1028831817 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8caea00640 1 --2- 172.21.15.146:0/1028831817 >> v2:172.21.15.150:3300/0 conn(0x7f8cb00aa7d0 0x7f8cb006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486389512 0 0) 0x7f8cb00a9a10 con 0x7f8cb006da20 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c940034e0 con 0x7f8cb006da20 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142086887 0 0) 0x7f8c940034e0 con 0x7f8cb006da20 2024-08-17T02:26:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 >> v2:172.21.15.150:3300/0 conn(0x7f8cb00aa7d0 msgr2=0x7f8cb006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 --2- 172.21.15.146:0/1028831817 >> v2:172.21.15.150:3300/0 conn(0x7f8cb00aa7d0 0x7f8cb006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 >> v1:172.21.15.150:6789/0 conn(0x7f8cb0158fa0 legacy=0x7f8cb00ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00a9fd0 con 0x7f8cb006da20 2024-08-17T02:26:57.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f8ca0001470 con 0x7f8cb006da20 2024-08-17T02:26:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 >> v1:172.21.15.146:6789/0 conn(0x7f8cb006da20 legacy=0x7f8cb0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.613+0000 7f8cae000640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c940039d0 0x7f8c94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cae000640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 0x7f8c94004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cae000640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94005130 0x7f8c9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00ac400 con 0x7f8c94004780 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400c050 con 0x7f8c940039d0 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9400c210 con 0x7f8c94005130 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 0x7f8c94004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caf400640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c940039d0 0x7f8c94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cafe00640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94005130 0x7f8c9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 -- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94005130 msgr2=0x7f8c9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94005130 0x7f8c9400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 -- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c940039d0 msgr2=0x7f8c94003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c940039d0 0x7f8c94003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8caea00640 1 -- 172.21.15.146:0/1028831817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940034e0 con 0x7f8c94004780 2024-08-17T02:26:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.614+0000 7f8cafe00640 1 -- 172.21.15.146:0/1028831817 reap_dead start 2024-08-17T02:26:57.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.615+0000 7f8caea00640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 0x7f8c94004bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009b70 tx=0x7f8c9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b39463e0d826246 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c031400 con 0x7f8c94004780 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c02d050 con 0x7f8c94004780 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cae000640 1 -- 172.21.15.146:0/1028831817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c031790 con 0x7f8c94004780 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 -- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 msgr2=0x7f8c94004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 0x7f8c94004bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009b70 tx=0x7f8c9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 -- 172.21.15.146:0/1028831817 shutdown_connections 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 --2- 172.21.15.146:0/1028831817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c94004780 0x7f8c94004bf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 -- 172.21.15.146:0/1028831817 >> 172.21.15.146:0/1028831817 conn(0x7f8cb00cb9b0 msgr2=0x7f8cb00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 -- 172.21.15.146:0/1028831817 shutdown_connections 2024-08-17T02:26:57.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.616+0000 7f8cb6600640 1 -- 172.21.15.146:0/1028831817 wait complete. 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.618+0000 7f8cb6600640 1 Processor -- start 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.618+0000 7f8cb6600640 1 -- start start 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94004780 0x7f8cb0154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cb0169660 0x7f8cb00b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0157560 con 0x7f8cb0168cb0 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00afe90 con 0x7f8cb0169660 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cb6600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0154bb0 con 0x7f8c94004780 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39698/0 (socket says 172.21.15.146:39698) 2024-08-17T02:26:57.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 -- 172.21.15.146:0/2242816520 learned_addr learned my addr 172.21.15.146:0/2242816520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caf400640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94004780 0x7f8cb0154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8cafe00640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cb0169660 0x7f8cb00b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 -- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94004780 msgr2=0x7f8cb0154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94004780 0x7f8cb0154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 -- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cb0169660 msgr2=0x7f8cb00b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cb0169660 0x7f8cb00b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.619+0000 7f8caea00640 1 -- 172.21.15.146:0/2242816520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb0156fa0 con 0x7f8cb0168cb0 2024-08-17T02:26:57.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8caea00640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009bd0 tx=0x7f8c9c035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c000c40 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c030a60 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c030e20 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb0157280 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.620+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb0169ad0 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.621+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb00afcc0 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.622+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c9c045620 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.623+0000 7f8ca6a00640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 0x7f8c90067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.623+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c9c0a3570 con 0x7f8cb0168cb0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.623+0000 7f8caf400640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 0x7f8c90067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.624+0000 7f8caf400640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 0x7f8c90067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c8b80 tx=0x7f8ca0001e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:57.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.627+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c9c071640 con 0x7f8cb0168cb0 2024-08-17T02:26:57.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.802+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cb0064db0 con 0x7f8c90065180 2024-08-17T02:26:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.810+0000 7f8ca6a00640 1 -- 172.21.15.146:0/2242816520 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288705 (secure 0 0 0) 0x7f8cb0064db0 con 0x7f8c90065180 2024-08-17T02:26:57.815 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:57.816 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.813+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 msgr2=0x7f8c90067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.813+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 0x7f8c90067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c8b80 tx=0x7f8ca0001e70 comp rx=0 tx=0).stop 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.813+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 msgr2=0x7f8cb0169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.813+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009bd0 tx=0x7f8c9c035000 comp rx=0 tx=0).stop 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 shutdown_connections 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8c90065180 0x7f8c90067630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb0168cb0 0x7f8cb0169120 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8cb0169660 0x7f8cb00b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 --2- 172.21.15.146:0/2242816520 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c94004780 0x7f8cb0154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:57.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 >> 172.21.15.146:0/2242816520 conn(0x7f8cb00cb9b0 msgr2=0x7f8cb00ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:57.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 shutdown_connections 2024-08-17T02:26:57.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:57.814+0000 7f8cb6600640 1 -- 172.21.15.146:0/2242816520 wait complete. 2024-08-17T02:26:57.830 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:26:56.333588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382912,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591808,"statfs":{"total":773094113280,"available":770654011392,"internally_reserved":0,"allocated":4136960,"data_stored":2306444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.091331"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277334+0000","last_change":"2024-08-17T02:26:53.273917+0000","last_active":"2024-08-17T02:26:53.277334+0000","last_peered":"2024-08-17T02:26:53.277334+0000","last_clean":"2024-08-17T02:26:53.277334+0000","last_became_active":"2024-08-17T02:26:53.273631+0000","last_became_peered":"2024-08-17T02:26:53.273631+0000","last_unstale":"2024-08-17T02:26:53.277334+0000","last_undegraded":"2024-08-17T02:26:53.277334+0000","last_fullsized":"2024-08-17T02:26:53.277334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.293318+0000","last_change":"2024-08-17T02:26:53.292328+0000","last_active":"2024-08-17T02:26:53.293318+0000","last_peered":"2024-08-17T02:26:53.293318+0000","last_clean":"2024-08-17T02:26:53.293318+0000","last_became_active":"2024-08-17T02:26:53.291993+0000","last_became_peered":"2024-08-17T02:26:53.291993+0000","last_unstale":"2024-08-17T02:26:53.293318+0000","last_undegraded":"2024-08-17T02:26:53.293318+0000","last_fullsized":"2024-08-17T02:26:53.293318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:27.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295399+0000","last_change":"2024-08-17T02:26:53.291598+0000","last_active":"2024-08-17T02:26:53.295399+0000","last_peered":"2024-08-17T02:26:53.295399+0000","last_clean":"2024-08-17T02:26:53.295399+0000","last_became_active":"2024-08-17T02:26:53.291103+0000","last_became_peered":"2024-08-17T02:26:53.291103+0000","last_unstale":"2024-08-17T02:26:53.295399+0000","last_undegraded":"2024-08-17T02:26:53.295399+0000","last_fullsized":"2024-08-17T02:26:53.295399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:55.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289871+0000","last_change":"2024-08-17T02:26:53.286746+0000","last_active":"2024-08-17T02:26:53.289871+0000","last_peered":"2024-08-17T02:26:53.289871+0000","last_clean":"2024-08-17T02:26:53.289871+0000","last_became_active":"2024-08-17T02:26:53.286336+0000","last_became_peered":"2024-08-17T02:26:53.286336+0000","last_unstale":"2024-08-17T02:26:53.289871+0000","last_undegraded":"2024-08-17T02:26:53.289871+0000","last_fullsized":"2024-08-17T02:26:53.289871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:00.025355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.274905+0000","last_change":"2024-08-17T02:26:53.272305+0000","last_active":"2024-08-17T02:26:53.274905+0000","last_peered":"2024-08-17T02:26:53.274905+0000","last_clean":"2024-08-17T02:26:53.274905+0000","last_became_active":"2024-08-17T02:26:53.271950+0000","last_became_peered":"2024-08-17T02:26:53.271950+0000","last_unstale":"2024-08-17T02:26:53.274905+0000","last_undegraded":"2024-08-17T02:26:53.274905+0000","last_fullsized":"2024-08-17T02:26:53.274905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:32.426380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279594+0000","last_change":"2024-08-17T02:26:53.271973+0000","last_active":"2024-08-17T02:26:53.279594+0000","last_peered":"2024-08-17T02:26:53.279594+0000","last_clean":"2024-08-17T02:26:53.279594+0000","last_became_active":"2024-08-17T02:26:53.271721+0000","last_became_peered":"2024-08-17T02:26:53.271721+0000","last_unstale":"2024-08-17T02:26:53.279594+0000","last_undegraded":"2024-08-17T02:26:53.279594+0000","last_fullsized":"2024-08-17T02:26:53.279594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:13:20.942203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275853+0000","last_change":"2024-08-17T02:26:53.272925+0000","last_active":"2024-08-17T02:26:53.275853+0000","last_peered":"2024-08-17T02:26:53.275853+0000","last_clean":"2024-08-17T02:26:53.275853+0000","last_became_active":"2024-08-17T02:26:53.271806+0000","last_became_peered":"2024-08-17T02:26:53.271806+0000","last_unstale":"2024-08-17T02:26:53.275853+0000","last_undegraded":"2024-08-17T02:26:53.275853+0000","last_fullsized":"2024-08-17T02:26:53.275853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287138+0000","last_change":"2024-08-17T02:26:53.282701+0000","last_active":"2024-08-17T02:26:53.287138+0000","last_peered":"2024-08-17T02:26:53.287138+0000","last_clean":"2024-08-17T02:26:53.287138+0000","last_became_active":"2024-08-17T02:26:53.282444+0000","last_became_peered":"2024-08-17T02:26:53.282444+0000","last_unstale":"2024-08-17T02:26:53.287138+0000","last_undegraded":"2024-08-17T02:26:53.287138+0000","last_fullsized":"2024-08-17T02:26:53.287138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288922+0000","last_change":"2024-08-17T02:26:53.286305+0000","last_active":"2024-08-17T02:26:53.288922+0000","last_peered":"2024-08-17T02:26:53.288922+0000","last_clean":"2024-08-17T02:26:53.288922+0000","last_became_active":"2024-08-17T02:26:53.286017+0000","last_became_peered":"2024-08-17T02:26:53.286017+0000","last_unstale":"2024-08-17T02:26:53.288922+0000","last_undegraded":"2024-08-17T02:26:53.288922+0000","last_fullsized":"2024-08-17T02:26:53.288922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278252+0000","last_change":"2024-08-17T02:26:53.272708+0000","last_active":"2024-08-17T02:26:53.278252+0000","last_peered":"2024-08-17T02:26:53.278252+0000","last_clean":"2024-08-17T02:26:53.278252+0000","last_became_active":"2024-08-17T02:26:53.270723+0000","last_became_peered":"2024-08-17T02:26:53.270723+0000","last_unstale":"2024-08-17T02:26:53.278252+0000","last_undegraded":"2024-08-17T02:26:53.278252+0000","last_fullsized":"2024-08-17T02:26:53.278252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.272023+0000","last_change":"2024-08-17T02:26:53.269509+0000","last_active":"2024-08-17T02:26:53.272023+0000","last_peered":"2024-08-17T02:26:53.272023+0000","last_clean":"2024-08-17T02:26:53.272023+0000","last_became_active":"2024-08-17T02:26:53.269215+0000","last_became_peered":"2024-08-17T02:26:53.269215+0000","last_unstale":"2024-08-17T02:26:53.272023+0000","last_undegraded":"2024-08-17T02:26:53.272023+0000","last_fullsized":"2024-08-17T02:26:53.272023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:00.025355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287947+0000","last_change":"2024-08-17T02:26:53.280978+0000","last_active":"2024-08-17T02:26:53.287947+0000","last_peered":"2024-08-17T02:26:53.287947+0000","last_clean":"2024-08-17T02:26:53.287947+0000","last_became_active":"2024-08-17T02:26:53.280702+0000","last_became_peered":"2024-08-17T02:26:53.280702+0000","last_unstale":"2024-08-17T02:26:53.287947+0000","last_undegraded":"2024-08-17T02:26:53.287947+0000","last_fullsized":"2024-08-17T02:26:53.287947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:27.055938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289928+0000","last_change":"2024-08-17T02:26:53.286804+0000","last_active":"2024-08-17T02:26:53.289928+0000","last_peered":"2024-08-17T02:26:53.289928+0000","last_clean":"2024-08-17T02:26:53.289928+0000","last_became_active":"2024-08-17T02:26:53.286026+0000","last_became_peered":"2024-08-17T02:26:53.286026+0000","last_unstale":"2024-08-17T02:26:53.289928+0000","last_undegraded":"2024-08-17T02:26:53.289928+0000","last_fullsized":"2024-08-17T02:26:53.289928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.355057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279576+0000","last_change":"2024-08-17T02:26:53.271584+0000","last_active":"2024-08-17T02:26:53.279576+0000","last_peered":"2024-08-17T02:26:53.279576+0000","last_clean":"2024-08-17T02:26:53.279576+0000","last_became_active":"2024-08-17T02:26:53.271309+0000","last_became_peered":"2024-08-17T02:26:53.271309+0000","last_unstale":"2024-08-17T02:26:53.279576+0000","last_undegraded":"2024-08-17T02:26:53.279576+0000","last_fullsized":"2024-08-17T02:26:53.279576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:55.264306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283659+0000","last_change":"2024-08-17T02:26:53.278246+0000","last_active":"2024-08-17T02:26:53.283659+0000","last_peered":"2024-08-17T02:26:53.283659+0000","last_clean":"2024-08-17T02:26:53.283659+0000","last_became_active":"2024-08-17T02:26:53.277664+0000","last_became_peered":"2024-08-17T02:26:53.277664+0000","last_unstale":"2024-08-17T02:26:53.283659+0000","last_undegraded":"2024-08-17T02:26:53.283659+0000","last_fullsized":"2024-08-17T02:26:53.283659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267028+0000","last_change":"2024-08-17T02:26:53.263731+0000","last_active":"2024-08-17T02:26:53.267028+0000","last_peered":"2024-08-17T02:26:53.267028+0000","last_clean":"2024-08-17T02:26:53.267028+0000","last_became_active":"2024-08-17T02:26:53.263425+0000","last_became_peered":"2024-08-17T02:26:53.263425+0000","last_unstale":"2024-08-17T02:26:53.267028+0000","last_undegraded":"2024-08-17T02:26:53.267028+0000","last_fullsized":"2024-08-17T02:26:53.267028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:46.299279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278009+0000","last_change":"2024-08-17T02:26:53.276420+0000","last_active":"2024-08-17T02:26:53.278009+0000","last_peered":"2024-08-17T02:26:53.278009+0000","last_clean":"2024-08-17T02:26:53.278009+0000","last_became_active":"2024-08-17T02:26:53.275780+0000","last_became_peered":"2024-08-17T02:26:53.275780+0000","last_unstale":"2024-08-17T02:26:53.278009+0000","last_undegraded":"2024-08-17T02:26:53.278009+0000","last_fullsized":"2024-08-17T02:26:53.278009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270329+0000","last_change":"2024-08-17T02:26:53.267904+0000","last_active":"2024-08-17T02:26:53.270329+0000","last_peered":"2024-08-17T02:26:53.270329+0000","last_clean":"2024-08-17T02:26:53.270329+0000","last_became_active":"2024-08-17T02:26:53.267624+0000","last_became_peered":"2024-08-17T02:26:53.267624+0000","last_unstale":"2024-08-17T02:26:53.270329+0000","last_undegraded":"2024-08-17T02:26:53.270329+0000","last_fullsized":"2024-08-17T02:26:53.270329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:10:12.369580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279544+0000","last_change":"2024-08-17T02:26:53.271463+0000","last_active":"2024-08-17T02:26:53.279544+0000","last_peered":"2024-08-17T02:26:53.279544+0000","last_clean":"2024-08-17T02:26:53.279544+0000","last_became_active":"2024-08-17T02:26:53.270147+0000","last_became_peered":"2024-08-17T02:26:53.270147+0000","last_unstale":"2024-08-17T02:26:53.279544+0000","last_undegraded":"2024-08-17T02:26:53.279544+0000","last_fullsized":"2024-08-17T02:26:53.279544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:31:49.034807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285598+0000","last_change":"2024-08-17T02:26:53.279222+0000","last_active":"2024-08-17T02:26:53.285598+0000","last_peered":"2024-08-17T02:26:53.285598+0000","last_clean":"2024-08-17T02:26:53.285598+0000","last_became_active":"2024-08-17T02:26:53.278893+0000","last_became_peered":"2024-08-17T02:26:53.278893+0000","last_unstale":"2024-08-17T02:26:53.285598+0000","last_undegraded":"2024-08-17T02:26:53.285598+0000","last_fullsized":"2024-08-17T02:26:53.285598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288693+0000","last_change":"2024-08-17T02:26:53.282214+0000","last_active":"2024-08-17T02:26:53.288693+0000","last_peered":"2024-08-17T02:26:53.288693+0000","last_clean":"2024-08-17T02:26:53.288693+0000","last_became_active":"2024-08-17T02:26:53.281953+0000","last_became_peered":"2024-08-17T02:26:53.281953+0000","last_unstale":"2024-08-17T02:26:53.288693+0000","last_undegraded":"2024-08-17T02:26:53.288693+0000","last_fullsized":"2024-08-17T02:26:53.288693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:32.547394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283694+0000","last_change":"2024-08-17T02:26:53.277313+0000","last_active":"2024-08-17T02:26:53.283694+0000","last_peered":"2024-08-17T02:26:53.283694+0000","last_clean":"2024-08-17T02:26:53.283694+0000","last_became_active":"2024-08-17T02:26:53.277002+0000","last_became_peered":"2024-08-17T02:26:53.277002+0000","last_unstale":"2024-08-17T02:26:53.283694+0000","last_undegraded":"2024-08-17T02:26:53.283694+0000","last_fullsized":"2024-08-17T02:26:53.283694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.290824+0000","last_change":"2024-08-17T02:26:53.273088+0000","last_active":"2024-08-17T02:26:53.290824+0000","last_peered":"2024-08-17T02:26:53.290824+0000","last_clean":"2024-08-17T02:26:53.290824+0000","last_became_active":"2024-08-17T02:26:53.272704+0000","last_became_peered":"2024-08-17T02:26:53.272704+0000","last_unstale":"2024-08-17T02:26:53.290824+0000","last_undegraded":"2024-08-17T02:26:53.290824+0000","last_fullsized":"2024-08-17T02:26:53.290824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288393+0000","last_change":"2024-08-17T02:26:53.285196+0000","last_active":"2024-08-17T02:26:53.288393+0000","last_peered":"2024-08-17T02:26:53.288393+0000","last_clean":"2024-08-17T02:26:53.288393+0000","last_became_active":"2024-08-17T02:26:53.283804+0000","last_became_peered":"2024-08-17T02:26:53.283804+0000","last_unstale":"2024-08-17T02:26:53.288393+0000","last_undegraded":"2024-08-17T02:26:53.288393+0000","last_fullsized":"2024-08-17T02:26:53.288393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285698+0000","last_change":"2024-08-17T02:26:53.276957+0000","last_active":"2024-08-17T02:26:53.285698+0000","last_peered":"2024-08-17T02:26:53.285698+0000","last_clean":"2024-08-17T02:26:53.285698+0000","last_became_active":"2024-08-17T02:26:53.276619+0000","last_became_peered":"2024-08-17T02:26:53.276619+0000","last_unstale":"2024-08-17T02:26:53.285698+0000","last_undegraded":"2024-08-17T02:26:53.285698+0000","last_fullsized":"2024-08-17T02:26:53.285698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267321+0000","last_change":"2024-08-17T02:26:53.262315+0000","last_active":"2024-08-17T02:26:53.267321+0000","last_peered":"2024-08-17T02:26:53.267321+0000","last_clean":"2024-08-17T02:26:53.267321+0000","last_became_active":"2024-08-17T02:26:53.262066+0000","last_became_peered":"2024-08-17T02:26:53.262066+0000","last_unstale":"2024-08-17T02:26:53.267321+0000","last_undegraded":"2024-08-17T02:26:53.267321+0000","last_fullsized":"2024-08-17T02:26:53.267321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:09.536981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295586+0000","last_change":"2024-08-17T02:26:53.289537+0000","last_active":"2024-08-17T02:26:53.295586+0000","last_peered":"2024-08-17T02:26:53.295586+0000","last_clean":"2024-08-17T02:26:53.295586+0000","last_became_active":"2024-08-17T02:26:53.288810+0000","last_became_peered":"2024-08-17T02:26:53.288810+0000","last_unstale":"2024-08-17T02:26:53.295586+0000","last_undegraded":"2024-08-17T02:26:53.295586+0000","last_fullsized":"2024-08-17T02:26:53.295586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:12.342222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277921+0000","last_change":"2024-08-17T02:26:53.274291+0000","last_active":"2024-08-17T02:26:53.277921+0000","last_peered":"2024-08-17T02:26:53.277921+0000","last_clean":"2024-08-17T02:26:53.277921+0000","last_became_active":"2024-08-17T02:26:53.274010+0000","last_became_peered":"2024-08-17T02:26:53.274010+0000","last_unstale":"2024-08-17T02:26:53.277921+0000","last_undegraded":"2024-08-17T02:26:53.277921+0000","last_fullsized":"2024-08-17T02:26:53.277921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:06.350384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288730+0000","last_change":"2024-08-17T02:26:53.282907+0000","last_active":"2024-08-17T02:26:53.288730+0000","last_peered":"2024-08-17T02:26:53.288730+0000","last_clean":"2024-08-17T02:26:53.288730+0000","last_became_active":"2024-08-17T02:26:53.277778+0000","last_became_peered":"2024-08-17T02:26:53.277778+0000","last_unstale":"2024-08-17T02:26:53.288730+0000","last_undegraded":"2024-08-17T02:26:53.288730+0000","last_fullsized":"2024-08-17T02:26:53.288730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:33.850354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277869+0000","last_change":"2024-08-17T02:26:53.276151+0000","last_active":"2024-08-17T02:26:53.277869+0000","last_peered":"2024-08-17T02:26:53.277869+0000","last_clean":"2024-08-17T02:26:53.277869+0000","last_became_active":"2024-08-17T02:26:53.275443+0000","last_became_peered":"2024-08-17T02:26:53.275443+0000","last_unstale":"2024-08-17T02:26:53.277869+0000","last_undegraded":"2024-08-17T02:26:53.277869+0000","last_fullsized":"2024-08-17T02:26:53.277869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:14:40.675935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.281513+0000","last_change":"2024-08-17T02:26:53.278830+0000","last_active":"2024-08-17T02:26:53.281513+0000","last_peered":"2024-08-17T02:26:53.281513+0000","last_clean":"2024-08-17T02:26:53.281513+0000","last_became_active":"2024-08-17T02:26:53.275449+0000","last_became_peered":"2024-08-17T02:26:53.275449+0000","last_unstale":"2024-08-17T02:26:53.281513+0000","last_undegraded":"2024-08-17T02:26:53.281513+0000","last_fullsized":"2024-08-17T02:26:53.281513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:32.426380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288312+0000","last_change":"2024-08-17T02:26:53.285455+0000","last_active":"2024-08-17T02:26:53.288312+0000","last_peered":"2024-08-17T02:26:53.288312+0000","last_clean":"2024-08-17T02:26:53.288312+0000","last_became_active":"2024-08-17T02:26:53.285098+0000","last_became_peered":"2024-08-17T02:26:53.285098+0000","last_unstale":"2024-08-17T02:26:53.288312+0000","last_undegraded":"2024-08-17T02:26:53.288312+0000","last_fullsized":"2024-08-17T02:26:53.288312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:55.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286586+0000","last_change":"2024-08-17T02:26:53.272249+0000","last_active":"2024-08-17T02:26:53.286586+0000","last_peered":"2024-08-17T02:26:53.286586+0000","last_clean":"2024-08-17T02:26:53.286586+0000","last_became_active":"2024-08-17T02:26:53.271986+0000","last_became_peered":"2024-08-17T02:26:53.271986+0000","last_unstale":"2024-08-17T02:26:53.286586+0000","last_undegraded":"2024-08-17T02:26:53.286586+0000","last_fullsized":"2024-08-17T02:26:53.286586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:07.805350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296447+0000","last_change":"2024-08-17T02:26:52.273252+0000","last_active":"2024-08-17T02:26:53.296447+0000","last_peered":"2024-08-17T02:26:53.296447+0000","last_clean":"2024-08-17T02:26:53.296447+0000","last_became_active":"2024-08-17T02:26:52.272976+0000","last_became_peered":"2024-08-17T02:26:52.272976+0000","last_unstale":"2024-08-17T02:26:53.296447+0000","last_undegraded":"2024-08-17T02:26:53.296447+0000","last_fullsized":"2024-08-17T02:26:53.296447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287724+0000","last_change":"2024-08-17T02:26:53.286336+0000","last_active":"2024-08-17T02:26:53.287724+0000","last_peered":"2024-08-17T02:26:53.287724+0000","last_clean":"2024-08-17T02:26:53.287724+0000","last_became_active":"2024-08-17T02:26:53.285662+0000","last_became_peered":"2024-08-17T02:26:53.285662+0000","last_unstale":"2024-08-17T02:26:53.287724+0000","last_undegraded":"2024-08-17T02:26:53.287724+0000","last_fullsized":"2024-08-17T02:26:53.287724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294921+0000","last_change":"2024-08-17T02:26:52.274012+0000","last_active":"2024-08-17T02:26:53.294921+0000","last_peered":"2024-08-17T02:26:53.294921+0000","last_clean":"2024-08-17T02:26:53.294921+0000","last_became_active":"2024-08-17T02:26:52.273740+0000","last_became_peered":"2024-08-17T02:26:52.273740+0000","last_unstale":"2024-08-17T02:26:53.294921+0000","last_undegraded":"2024-08-17T02:26:53.294921+0000","last_fullsized":"2024-08-17T02:26:53.294921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.282410+0000","last_change":"2024-08-17T02:26:53.278406+0000","last_active":"2024-08-17T02:26:53.282410+0000","last_peered":"2024-08-17T02:26:53.282410+0000","last_clean":"2024-08-17T02:26:53.282410+0000","last_became_active":"2024-08-17T02:26:53.278085+0000","last_became_peered":"2024-08-17T02:26:53.278085+0000","last_unstale":"2024-08-17T02:26:53.282410+0000","last_undegraded":"2024-08-17T02:26:53.282410+0000","last_fullsized":"2024-08-17T02:26:53.282410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.301435+0000","last_change":"2024-08-17T02:26:52.270985+0000","last_active":"2024-08-17T02:26:53.301435+0000","last_peered":"2024-08-17T02:26:53.301435+0000","last_clean":"2024-08-17T02:26:53.301435+0000","last_became_active":"2024-08-17T02:26:52.270748+0000","last_became_peered":"2024-08-17T02:26:52.270748+0000","last_unstale":"2024-08-17T02:26:53.301435+0000","last_undegraded":"2024-08-17T02:26:53.301435+0000","last_fullsized":"2024-08-17T02:26:53.301435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:31.539920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295633+0000","last_change":"2024-08-17T02:26:53.290008+0000","last_active":"2024-08-17T02:26:53.295633+0000","last_peered":"2024-08-17T02:26:53.295633+0000","last_clean":"2024-08-17T02:26:53.295633+0000","last_became_active":"2024-08-17T02:26:53.289132+0000","last_became_peered":"2024-08-17T02:26:53.289132+0000","last_unstale":"2024-08-17T02:26:53.295633+0000","last_undegraded":"2024-08-17T02:26:53.295633+0000","last_fullsized":"2024-08-17T02:26:53.295633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:29.149892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.290418+0000","last_change":"2024-08-17T02:26:52.272490+0000","last_active":"2024-08-17T02:26:53.290418+0000","last_peered":"2024-08-17T02:26:53.290418+0000","last_clean":"2024-08-17T02:26:53.290418+0000","last_became_active":"2024-08-17T02:26:52.272248+0000","last_became_peered":"2024-08-17T02:26:52.272248+0000","last_unstale":"2024-08-17T02:26:53.290418+0000","last_undegraded":"2024-08-17T02:26:53.290418+0000","last_fullsized":"2024-08-17T02:26:53.290418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:19.443498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.284035+0000","last_change":"2024-08-17T02:26:53.280884+0000","last_active":"2024-08-17T02:26:53.284035+0000","last_peered":"2024-08-17T02:26:53.284035+0000","last_clean":"2024-08-17T02:26:53.284035+0000","last_became_active":"2024-08-17T02:26:53.279599+0000","last_became_peered":"2024-08-17T02:26:53.279599+0000","last_unstale":"2024-08-17T02:26:53.284035+0000","last_undegraded":"2024-08-17T02:26:53.284035+0000","last_fullsized":"2024-08-17T02:26:53.284035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:06.350384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.298908+0000","last_change":"2024-08-17T02:26:52.275961+0000","last_active":"2024-08-17T02:26:53.298908+0000","last_peered":"2024-08-17T02:26:53.298908+0000","last_clean":"2024-08-17T02:26:53.298908+0000","last_became_active":"2024-08-17T02:26:52.275393+0000","last_became_peered":"2024-08-17T02:26:52.275393+0000","last_unstale":"2024-08-17T02:26:53.298908+0000","last_undegraded":"2024-08-17T02:26:53.298908+0000","last_fullsized":"2024-08-17T02:26:53.298908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283637+0000","last_change":"2024-08-17T02:26:53.278734+0000","last_active":"2024-08-17T02:26:53.283637+0000","last_peered":"2024-08-17T02:26:53.283637+0000","last_clean":"2024-08-17T02:26:53.283637+0000","last_became_active":"2024-08-17T02:26:53.278422+0000","last_became_peered":"2024-08-17T02:26:53.278422+0000","last_unstale":"2024-08-17T02:26:53.283637+0000","last_undegraded":"2024-08-17T02:26:53.283637+0000","last_fullsized":"2024-08-17T02:26:53.283637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:38.783071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.299694+0000","last_change":"2024-08-17T02:26:52.275538+0000","last_active":"2024-08-17T02:26:53.299694+0000","last_peered":"2024-08-17T02:26:53.299694+0000","last_clean":"2024-08-17T02:26:53.299694+0000","last_became_active":"2024-08-17T02:26:52.275223+0000","last_became_peered":"2024-08-17T02:26:52.275223+0000","last_unstale":"2024-08-17T02:26:53.299694+0000","last_undegraded":"2024-08-17T02:26:53.299694+0000","last_fullsized":"2024-08-17T02:26:53.299694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:24:37.615112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.281989+0000","last_change":"2024-08-17T02:26:53.275227+0000","last_active":"2024-08-17T02:26:53.281989+0000","last_peered":"2024-08-17T02:26:53.281989+0000","last_clean":"2024-08-17T02:26:53.281989+0000","last_became_active":"2024-08-17T02:26:53.274938+0000","last_became_peered":"2024-08-17T02:26:53.274938+0000","last_unstale":"2024-08-17T02:26:53.281989+0000","last_undegraded":"2024-08-17T02:26:53.281989+0000","last_fullsized":"2024-08-17T02:26:53.281989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.256035+0000","last_change":"2024-08-17T02:26:52.267821+0000","last_active":"2024-08-17T02:26:53.256035+0000","last_peered":"2024-08-17T02:26:53.256035+0000","last_clean":"2024-08-17T02:26:53.256035+0000","last_became_active":"2024-08-17T02:26:52.267549+0000","last_became_peered":"2024-08-17T02:26:52.267549+0000","last_unstale":"2024-08-17T02:26:53.256035+0000","last_undegraded":"2024-08-17T02:26:53.256035+0000","last_fullsized":"2024-08-17T02:26:53.256035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:06.797876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289236+0000","last_change":"2024-08-17T02:26:53.283246+0000","last_active":"2024-08-17T02:26:53.289236+0000","last_peered":"2024-08-17T02:26:53.289236+0000","last_clean":"2024-08-17T02:26:53.289236+0000","last_became_active":"2024-08-17T02:26:53.282997+0000","last_became_peered":"2024-08-17T02:26:53.282997+0000","last_unstale":"2024-08-17T02:26:53.289236+0000","last_undegraded":"2024-08-17T02:26:53.289236+0000","last_fullsized":"2024-08-17T02:26:53.289236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:15.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270108+0000","last_change":"2024-08-17T02:26:52.274989+0000","last_active":"2024-08-17T02:26:53.270108+0000","last_peered":"2024-08-17T02:26:53.270108+0000","last_clean":"2024-08-17T02:26:53.270108+0000","last_became_active":"2024-08-17T02:26:52.274250+0000","last_became_peered":"2024-08-17T02:26:52.274250+0000","last_unstale":"2024-08-17T02:26:53.270108+0000","last_undegraded":"2024-08-17T02:26:53.270108+0000","last_fullsized":"2024-08-17T02:26:53.270108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:28.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283499+0000","last_change":"2024-08-17T02:26:53.279839+0000","last_active":"2024-08-17T02:26:53.283499+0000","last_peered":"2024-08-17T02:26:53.283499+0000","last_clean":"2024-08-17T02:26:53.283499+0000","last_became_active":"2024-08-17T02:26:53.279579+0000","last_became_peered":"2024-08-17T02:26:53.279579+0000","last_unstale":"2024-08-17T02:26:53.283499+0000","last_undegraded":"2024-08-17T02:26:53.283499+0000","last_fullsized":"2024-08-17T02:26:53.283499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:14:40.675935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.257044+0000","last_change":"2024-08-17T02:26:52.273996+0000","last_active":"2024-08-17T02:26:53.257044+0000","last_peered":"2024-08-17T02:26:53.257044+0000","last_clean":"2024-08-17T02:26:53.257044+0000","last_became_active":"2024-08-17T02:26:52.273750+0000","last_became_peered":"2024-08-17T02:26:52.273750+0000","last_unstale":"2024-08-17T02:26:53.257044+0000","last_undegraded":"2024-08-17T02:26:53.257044+0000","last_fullsized":"2024-08-17T02:26:53.257044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:26.530417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286551+0000","last_change":"2024-08-17T02:26:53.279908+0000","last_active":"2024-08-17T02:26:53.286551+0000","last_peered":"2024-08-17T02:26:53.286551+0000","last_clean":"2024-08-17T02:26:53.286551+0000","last_became_active":"2024-08-17T02:26:53.278733+0000","last_became_peered":"2024-08-17T02:26:53.278733+0000","last_unstale":"2024-08-17T02:26:53.286551+0000","last_undegraded":"2024-08-17T02:26:53.286551+0000","last_fullsized":"2024-08-17T02:26:53.286551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:53:58.022226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292513+0000","last_change":"2024-08-17T02:26:52.271725+0000","last_active":"2024-08-17T02:26:53.292513+0000","last_peered":"2024-08-17T02:26:53.292513+0000","last_clean":"2024-08-17T02:26:53.292513+0000","last_became_active":"2024-08-17T02:26:52.270994+0000","last_became_peered":"2024-08-17T02:26:52.270994+0000","last_unstale":"2024-08-17T02:26:53.292513+0000","last_undegraded":"2024-08-17T02:26:53.292513+0000","last_fullsized":"2024-08-17T02:26:53.292513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.267536+0000","last_change":"2024-08-17T02:26:53.263720+0000","last_active":"2024-08-17T02:26:53.267536+0000","last_peered":"2024-08-17T02:26:53.267536+0000","last_clean":"2024-08-17T02:26:53.267536+0000","last_became_active":"2024-08-17T02:26:53.261127+0000","last_became_peered":"2024-08-17T02:26:53.261127+0000","last_unstale":"2024-08-17T02:26:53.267536+0000","last_undegraded":"2024-08-17T02:26:53.267536+0000","last_fullsized":"2024-08-17T02:26:53.267536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:03:27.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288605+0000","last_change":"2024-08-17T02:26:52.277066+0000","last_active":"2024-08-17T02:26:53.288605+0000","last_peered":"2024-08-17T02:26:53.288605+0000","last_clean":"2024-08-17T02:26:53.288605+0000","last_became_active":"2024-08-17T02:26:52.276481+0000","last_became_peered":"2024-08-17T02:26:52.276481+0000","last_unstale":"2024-08-17T02:26:53.288605+0000","last_undegraded":"2024-08-17T02:26:53.288605+0000","last_fullsized":"2024-08-17T02:26:53.288605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:01.347583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292533+0000","last_change":"2024-08-17T02:26:53.288323+0000","last_active":"2024-08-17T02:26:53.292533+0000","last_peered":"2024-08-17T02:26:53.292533+0000","last_clean":"2024-08-17T02:26:53.292533+0000","last_became_active":"2024-08-17T02:26:53.287210+0000","last_became_peered":"2024-08-17T02:26:53.287210+0000","last_unstale":"2024-08-17T02:26:53.292533+0000","last_undegraded":"2024-08-17T02:26:53.292533+0000","last_fullsized":"2024-08-17T02:26:53.292533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:13.671034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.303962+0000","last_change":"2024-08-17T02:26:52.275603+0000","last_active":"2024-08-17T02:26:53.303962+0000","last_peered":"2024-08-17T02:26:53.303962+0000","last_clean":"2024-08-17T02:26:53.303962+0000","last_became_active":"2024-08-17T02:26:52.275282+0000","last_became_peered":"2024-08-17T02:26:52.275282+0000","last_unstale":"2024-08-17T02:26:53.303962+0000","last_undegraded":"2024-08-17T02:26:53.303962+0000","last_fullsized":"2024-08-17T02:26:53.303962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:14.784981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295475+0000","last_change":"2024-08-17T02:26:53.287634+0000","last_active":"2024-08-17T02:26:53.295475+0000","last_peered":"2024-08-17T02:26:53.295475+0000","last_clean":"2024-08-17T02:26:53.295475+0000","last_became_active":"2024-08-17T02:26:53.287375+0000","last_became_peered":"2024-08-17T02:26:53.287375+0000","last_unstale":"2024-08-17T02:26:53.295475+0000","last_undegraded":"2024-08-17T02:26:53.295475+0000","last_fullsized":"2024-08-17T02:26:53.295475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:32.547394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296905+0000","last_change":"2024-08-17T02:26:52.271816+0000","last_active":"2024-08-17T02:26:53.296905+0000","last_peered":"2024-08-17T02:26:53.296905+0000","last_clean":"2024-08-17T02:26:53.296905+0000","last_became_active":"2024-08-17T02:26:52.269593+0000","last_became_peered":"2024-08-17T02:26:52.269593+0000","last_unstale":"2024-08-17T02:26:53.296905+0000","last_undegraded":"2024-08-17T02:26:53.296905+0000","last_fullsized":"2024-08-17T02:26:53.296905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:09.296896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.292352+0000","last_change":"2024-08-17T02:26:53.283303+0000","last_active":"2024-08-17T02:26:53.292352+0000","last_peered":"2024-08-17T02:26:53.292352+0000","last_clean":"2024-08-17T02:26:53.292352+0000","last_became_active":"2024-08-17T02:26:53.282987+0000","last_became_peered":"2024-08-17T02:26:53.282987+0000","last_unstale":"2024-08-17T02:26:53.292352+0000","last_undegraded":"2024-08-17T02:26:53.292352+0000","last_fullsized":"2024-08-17T02:26:53.292352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:04:24.222355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.262819+0000","last_change":"2024-08-17T02:26:52.267166+0000","last_active":"2024-08-17T02:26:53.262819+0000","last_peered":"2024-08-17T02:26:53.262819+0000","last_clean":"2024-08-17T02:26:53.262819+0000","last_became_active":"2024-08-17T02:26:52.266934+0000","last_became_peered":"2024-08-17T02:26:52.266934+0000","last_unstale":"2024-08-17T02:26:53.262819+0000","last_undegraded":"2024-08-17T02:26:53.262819+0000","last_fullsized":"2024-08-17T02:26:53.262819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:44.671728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288299+0000","last_change":"2024-08-17T02:26:53.285296+0000","last_active":"2024-08-17T02:26:53.288299+0000","last_peered":"2024-08-17T02:26:53.288299+0000","last_clean":"2024-08-17T02:26:53.288299+0000","last_became_active":"2024-08-17T02:26:53.284715+0000","last_became_peered":"2024-08-17T02:26:53.284715+0000","last_unstale":"2024-08-17T02:26:53.288299+0000","last_undegraded":"2024-08-17T02:26:53.288299+0000","last_fullsized":"2024-08-17T02:26:53.288299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:38.783071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.255894+0000","last_change":"2024-08-17T02:26:52.268036+0000","last_active":"2024-08-17T02:26:53.255894+0000","last_peered":"2024-08-17T02:26:53.255894+0000","last_clean":"2024-08-17T02:26:53.255894+0000","last_became_active":"2024-08-17T02:26:52.267787+0000","last_became_peered":"2024-08-17T02:26:52.267787+0000","last_unstale":"2024-08-17T02:26:53.255894+0000","last_undegraded":"2024-08-17T02:26:53.255894+0000","last_fullsized":"2024-08-17T02:26:53.255894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:53.208649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287696+0000","last_change":"2024-08-17T02:26:53.284299+0000","last_active":"2024-08-17T02:26:53.287696+0000","last_peered":"2024-08-17T02:26:53.287696+0000","last_clean":"2024-08-17T02:26:53.287696+0000","last_became_active":"2024-08-17T02:26:53.284026+0000","last_became_peered":"2024-08-17T02:26:53.284026+0000","last_unstale":"2024-08-17T02:26:53.287696+0000","last_undegraded":"2024-08-17T02:26:53.287696+0000","last_fullsized":"2024-08-17T02:26:53.287696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.302470+0000","last_change":"2024-08-17T02:26:52.269479+0000","last_active":"2024-08-17T02:26:53.302470+0000","last_peered":"2024-08-17T02:26:53.302470+0000","last_clean":"2024-08-17T02:26:53.302470+0000","last_became_active":"2024-08-17T02:26:52.269243+0000","last_became_peered":"2024-08-17T02:26:52.269243+0000","last_unstale":"2024-08-17T02:26:53.302470+0000","last_undegraded":"2024-08-17T02:26:53.302470+0000","last_fullsized":"2024-08-17T02:26:53.302470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:22.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.283538+0000","last_change":"2024-08-17T02:26:53.279123+0000","last_active":"2024-08-17T02:26:53.283538+0000","last_peered":"2024-08-17T02:26:53.283538+0000","last_clean":"2024-08-17T02:26:53.283538+0000","last_became_active":"2024-08-17T02:26:53.278820+0000","last_became_peered":"2024-08-17T02:26:53.278820+0000","last_unstale":"2024-08-17T02:26:53.283538+0000","last_undegraded":"2024-08-17T02:26:53.283538+0000","last_fullsized":"2024-08-17T02:26:53.283538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.300474+0000","last_change":"2024-08-17T02:26:52.269641+0000","last_active":"2024-08-17T02:26:53.300474+0000","last_peered":"2024-08-17T02:26:53.300474+0000","last_clean":"2024-08-17T02:26:53.300474+0000","last_became_active":"2024-08-17T02:26:52.268732+0000","last_became_peered":"2024-08-17T02:26:52.268732+0000","last_unstale":"2024-08-17T02:26:53.300474+0000","last_undegraded":"2024-08-17T02:26:53.300474+0000","last_fullsized":"2024-08-17T02:26:53.300474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:14.569903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.288339+0000","last_change":"2024-08-17T02:26:53.283428+0000","last_active":"2024-08-17T02:26:53.288339+0000","last_peered":"2024-08-17T02:26:53.288339+0000","last_clean":"2024-08-17T02:26:53.288339+0000","last_became_active":"2024-08-17T02:26:53.283157+0000","last_became_peered":"2024-08-17T02:26:53.283157+0000","last_unstale":"2024-08-17T02:26:53.288339+0000","last_undegraded":"2024-08-17T02:26:53.288339+0000","last_fullsized":"2024-08-17T02:26:53.288339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:55.609287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.296895+0000","last_change":"2024-08-17T02:26:52.270472+0000","last_active":"2024-08-17T02:26:53.296895+0000","last_peered":"2024-08-17T02:26:53.296895+0000","last_clean":"2024-08-17T02:26:53.296895+0000","last_became_active":"2024-08-17T02:26:52.269871+0000","last_became_peered":"2024-08-17T02:26:52.269871+0000","last_unstale":"2024-08-17T02:26:53.296895+0000","last_undegraded":"2024-08-17T02:26:53.296895+0000","last_fullsized":"2024-08-17T02:26:53.296895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:29.158186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.289850+0000","last_change":"2024-08-17T02:26:53.286615+0000","last_active":"2024-08-17T02:26:53.289850+0000","last_peered":"2024-08-17T02:26:53.289850+0000","last_clean":"2024-08-17T02:26:53.289850+0000","last_became_active":"2024-08-17T02:26:53.286030+0000","last_became_peered":"2024-08-17T02:26:53.286030+0000","last_unstale":"2024-08-17T02:26:53.289850+0000","last_undegraded":"2024-08-17T02:26:53.289850+0000","last_fullsized":"2024-08-17T02:26:53.289850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295486+0000","last_change":"2024-08-17T02:26:52.274282+0000","last_active":"2024-08-17T02:26:53.295486+0000","last_peered":"2024-08-17T02:26:53.295486+0000","last_clean":"2024-08-17T02:26:53.295486+0000","last_became_active":"2024-08-17T02:26:52.273991+0000","last_became_peered":"2024-08-17T02:26:52.273991+0000","last_unstale":"2024-08-17T02:26:53.295486+0000","last_undegraded":"2024-08-17T02:26:53.295486+0000","last_fullsized":"2024-08-17T02:26:53.295486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:19:58.751358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275763+0000","last_change":"2024-08-17T02:26:53.273470+0000","last_active":"2024-08-17T02:26:53.275763+0000","last_peered":"2024-08-17T02:26:53.275763+0000","last_clean":"2024-08-17T02:26:53.275763+0000","last_became_active":"2024-08-17T02:26:53.273227+0000","last_became_peered":"2024-08-17T02:26:53.273227+0000","last_unstale":"2024-08-17T02:26:53.275763+0000","last_undegraded":"2024-08-17T02:26:53.275763+0000","last_fullsized":"2024-08-17T02:26:53.275763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:29.582286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279081+0000","last_change":"2024-08-17T02:26:52.275542+0000","last_active":"2024-08-17T02:26:53.279081+0000","last_peered":"2024-08-17T02:26:53.279081+0000","last_clean":"2024-08-17T02:26:53.279081+0000","last_became_active":"2024-08-17T02:26:52.275217+0000","last_became_peered":"2024-08-17T02:26:52.275217+0000","last_unstale":"2024-08-17T02:26:53.279081+0000","last_undegraded":"2024-08-17T02:26:53.279081+0000","last_fullsized":"2024-08-17T02:26:53.279081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:17:40.494053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285741+0000","last_change":"2024-08-17T02:26:53.280287+0000","last_active":"2024-08-17T02:26:53.285741+0000","last_peered":"2024-08-17T02:26:53.285741+0000","last_clean":"2024-08-17T02:26:53.285741+0000","last_became_active":"2024-08-17T02:26:53.279960+0000","last_became_peered":"2024-08-17T02:26:53.279960+0000","last_unstale":"2024-08-17T02:26:53.285741+0000","last_undegraded":"2024-08-17T02:26:53.285741+0000","last_fullsized":"2024-08-17T02:26:53.285741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:40:23.189570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294681+0000","last_change":"2024-08-17T02:26:52.277108+0000","last_active":"2024-08-17T02:26:53.294681+0000","last_peered":"2024-08-17T02:26:53.294681+0000","last_clean":"2024-08-17T02:26:53.294681+0000","last_became_active":"2024-08-17T02:26:52.276859+0000","last_became_peered":"2024-08-17T02:26:52.276859+0000","last_unstale":"2024-08-17T02:26:53.294681+0000","last_undegraded":"2024-08-17T02:26:53.294681+0000","last_fullsized":"2024-08-17T02:26:53.294681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:44.671728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287341+0000","last_change":"2024-08-17T02:26:53.278545+0000","last_active":"2024-08-17T02:26:53.287341+0000","last_peered":"2024-08-17T02:26:53.287341+0000","last_clean":"2024-08-17T02:26:53.287341+0000","last_became_active":"2024-08-17T02:26:53.277951+0000","last_became_peered":"2024-08-17T02:26:53.277951+0000","last_unstale":"2024-08-17T02:26:53.287341+0000","last_undegraded":"2024-08-17T02:26:53.287341+0000","last_fullsized":"2024-08-17T02:26:53.287341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270670+0000","last_change":"2024-08-17T02:26:52.277367+0000","last_active":"2024-08-17T02:26:53.270670+0000","last_peered":"2024-08-17T02:26:53.270670+0000","last_clean":"2024-08-17T02:26:53.270670+0000","last_became_active":"2024-08-17T02:26:52.277106+0000","last_became_peered":"2024-08-17T02:26:52.277106+0000","last_unstale":"2024-08-17T02:26:53.270670+0000","last_undegraded":"2024-08-17T02:26:53.270670+0000","last_fullsized":"2024-08-17T02:26:53.270670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:01:29.158186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275389+0000","last_change":"2024-08-17T02:26:53.273947+0000","last_active":"2024-08-17T02:26:53.275389+0000","last_peered":"2024-08-17T02:26:53.275389+0000","last_clean":"2024-08-17T02:26:53.275389+0000","last_became_active":"2024-08-17T02:26:53.273719+0000","last_became_peered":"2024-08-17T02:26:53.273719+0000","last_unstale":"2024-08-17T02:26:53.275389+0000","last_undegraded":"2024-08-17T02:26:53.275389+0000","last_fullsized":"2024-08-17T02:26:53.275389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.278310+0000","last_change":"2024-08-17T02:26:52.277711+0000","last_active":"2024-08-17T02:26:53.278310+0000","last_peered":"2024-08-17T02:26:53.278310+0000","last_clean":"2024-08-17T02:26:53.278310+0000","last_became_active":"2024-08-17T02:26:52.275841+0000","last_became_peered":"2024-08-17T02:26:52.275841+0000","last_unstale":"2024-08-17T02:26:53.278310+0000","last_undegraded":"2024-08-17T02:26:53.278310+0000","last_fullsized":"2024-08-17T02:26:53.278310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.275872+0000","last_change":"2024-08-17T02:26:53.273296+0000","last_active":"2024-08-17T02:26:53.275872+0000","last_peered":"2024-08-17T02:26:53.275872+0000","last_clean":"2024-08-17T02:26:53.275872+0000","last_became_active":"2024-08-17T02:26:53.272164+0000","last_became_peered":"2024-08-17T02:26:53.272164+0000","last_unstale":"2024-08-17T02:26:53.275872+0000","last_undegraded":"2024-08-17T02:26:53.275872+0000","last_fullsized":"2024-08-17T02:26:53.275872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:57.906780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.268448+0000","last_change":"2024-08-17T02:26:52.276322+0000","last_active":"2024-08-17T02:26:53.268448+0000","last_peered":"2024-08-17T02:26:53.268448+0000","last_clean":"2024-08-17T02:26:53.268448+0000","last_became_active":"2024-08-17T02:26:52.276074+0000","last_became_peered":"2024-08-17T02:26:52.276074+0000","last_unstale":"2024-08-17T02:26:53.268448+0000","last_undegraded":"2024-08-17T02:26:53.268448+0000","last_fullsized":"2024-08-17T02:26:53.268448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:28.574812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.285361+0000","last_change":"2024-08-17T02:26:53.279047+0000","last_active":"2024-08-17T02:26:53.285361+0000","last_peered":"2024-08-17T02:26:53.285361+0000","last_clean":"2024-08-17T02:26:53.285361+0000","last_became_active":"2024-08-17T02:26:53.278799+0000","last_became_peered":"2024-08-17T02:26:53.278799+0000","last_unstale":"2024-08-17T02:26:53.285361+0000","last_undegraded":"2024-08-17T02:26:53.285361+0000","last_fullsized":"2024-08-17T02:26:53.285361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:27:54.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.293331+0000","last_change":"2024-08-17T02:26:52.270525+0000","last_active":"2024-08-17T02:26:53.293331+0000","last_peered":"2024-08-17T02:26:53.293331+0000","last_clean":"2024-08-17T02:26:53.293331+0000","last_became_active":"2024-08-17T02:26:52.269962+0000","last_became_peered":"2024-08-17T02:26:52.269962+0000","last_unstale":"2024-08-17T02:26:53.293331+0000","last_undegraded":"2024-08-17T02:26:53.293331+0000","last_fullsized":"2024-08-17T02:26:53.293331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:20:45.005650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.297142+0000","last_change":"2024-08-17T02:26:53.296440+0000","last_active":"2024-08-17T02:26:53.297142+0000","last_peered":"2024-08-17T02:26:53.297142+0000","last_clean":"2024-08-17T02:26:53.297142+0000","last_became_active":"2024-08-17T02:26:53.296071+0000","last_became_peered":"2024-08-17T02:26:53.296071+0000","last_unstale":"2024-08-17T02:26:53.297142+0000","last_undegraded":"2024-08-17T02:26:53.297142+0000","last_fullsized":"2024-08-17T02:26:53.297142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:29:46.299279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.286578+0000","last_change":"2024-08-17T02:26:52.276978+0000","last_active":"2024-08-17T02:26:53.286578+0000","last_peered":"2024-08-17T02:26:53.286578+0000","last_clean":"2024-08-17T02:26:53.286578+0000","last_became_active":"2024-08-17T02:26:52.276339+0000","last_became_peered":"2024-08-17T02:26:52.276339+0000","last_unstale":"2024-08-17T02:26:53.286578+0000","last_undegraded":"2024-08-17T02:26:53.286578+0000","last_fullsized":"2024-08-17T02:26:53.286578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:14.569903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.291065+0000","last_change":"2024-08-17T02:26:53.288898+0000","last_active":"2024-08-17T02:26:53.291065+0000","last_peered":"2024-08-17T02:26:53.291065+0000","last_clean":"2024-08-17T02:26:53.291065+0000","last_became_active":"2024-08-17T02:26:53.288619+0000","last_became_peered":"2024-08-17T02:26:53.288619+0000","last_unstale":"2024-08-17T02:26:53.291065+0000","last_undegraded":"2024-08-17T02:26:53.291065+0000","last_fullsized":"2024-08-17T02:26:53.291065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:50:27.537892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.264491+0000","last_change":"2024-08-17T02:26:52.271981+0000","last_active":"2024-08-17T02:26:53.264491+0000","last_peered":"2024-08-17T02:26:53.264491+0000","last_clean":"2024-08-17T02:26:53.264491+0000","last_became_active":"2024-08-17T02:26:52.267600+0000","last_became_peered":"2024-08-17T02:26:52.267600+0000","last_unstale":"2024-08-17T02:26:53.264491+0000","last_undegraded":"2024-08-17T02:26:53.264491+0000","last_fullsized":"2024-08-17T02:26:53.264491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:16:25.035021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.295715+0000","last_change":"2024-08-17T02:26:53.291971+0000","last_active":"2024-08-17T02:26:53.295715+0000","last_peered":"2024-08-17T02:26:53.295715+0000","last_clean":"2024-08-17T02:26:53.295715+0000","last_became_active":"2024-08-17T02:26:53.291595+0000","last_became_peered":"2024-08-17T02:26:53.291595+0000","last_unstale":"2024-08-17T02:26:53.295715+0000","last_undegraded":"2024-08-17T02:26:53.295715+0000","last_fullsized":"2024-08-17T02:26:53.295715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:31:02.355057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.277711+0000","last_change":"2024-08-17T02:26:52.273148+0000","last_active":"2024-08-17T02:26:53.277711+0000","last_peered":"2024-08-17T02:26:53.277711+0000","last_clean":"2024-08-17T02:26:53.277711+0000","last_became_active":"2024-08-17T02:26:52.272288+0000","last_became_peered":"2024-08-17T02:26:52.272288+0000","last_unstale":"2024-08-17T02:26:53.277711+0000","last_undegraded":"2024-08-17T02:26:53.277711+0000","last_fullsized":"2024-08-17T02:26:53.277711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:16:25.035021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.294532+0000","last_change":"2024-08-17T02:26:53.281150+0000","last_active":"2024-08-17T02:26:53.294532+0000","last_peered":"2024-08-17T02:26:53.294532+0000","last_clean":"2024-08-17T02:26:53.294532+0000","last_became_active":"2024-08-17T02:26:53.280408+0000","last_became_peered":"2024-08-17T02:26:53.280408+0000","last_unstale":"2024-08-17T02:26:53.294532+0000","last_undegraded":"2024-08-17T02:26:53.294532+0000","last_fullsized":"2024-08-17T02:26:53.294532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:32.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.263935+0000","last_change":"2024-08-17T02:26:52.267147+0000","last_active":"2024-08-17T02:26:53.263935+0000","last_peered":"2024-08-17T02:26:53.263935+0000","last_clean":"2024-08-17T02:26:53.263935+0000","last_became_active":"2024-08-17T02:26:52.266997+0000","last_became_peered":"2024-08-17T02:26:52.266997+0000","last_unstale":"2024-08-17T02:26:53.263935+0000","last_undegraded":"2024-08-17T02:26:53.263935+0000","last_fullsized":"2024-08-17T02:26:53.263935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.270506+0000","last_change":"2024-08-17T02:26:53.268276+0000","last_active":"2024-08-17T02:26:53.270506+0000","last_peered":"2024-08-17T02:26:53.270506+0000","last_clean":"2024-08-17T02:26:53.270506+0000","last_became_active":"2024-08-17T02:26:53.268041+0000","last_became_peered":"2024-08-17T02:26:53.268041+0000","last_unstale":"2024-08-17T02:26:53.270506+0000","last_undegraded":"2024-08-17T02:26:53.270506+0000","last_fullsized":"2024-08-17T02:26:53.270506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:13.671034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.279035+0000","last_change":"2024-08-17T02:26:52.274077+0000","last_active":"2024-08-17T02:26:53.279035+0000","last_peered":"2024-08-17T02:26:53.279035+0000","last_clean":"2024-08-17T02:26:53.279035+0000","last_became_active":"2024-08-17T02:26:52.273819+0000","last_became_peered":"2024-08-17T02:26:52.273819+0000","last_unstale":"2024-08-17T02:26:53.279035+0000","last_undegraded":"2024-08-17T02:26:53.279035+0000","last_fullsized":"2024-08-17T02:26:53.279035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:19.443498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.282807+0000","last_change":"2024-08-17T02:26:53.272649+0000","last_active":"2024-08-17T02:26:53.282807+0000","last_peered":"2024-08-17T02:26:53.282807+0000","last_clean":"2024-08-17T02:26:53.282807+0000","last_became_active":"2024-08-17T02:26:53.272365+0000","last_became_peered":"2024-08-17T02:26:53.272365+0000","last_unstale":"2024-08-17T02:26:53.282807+0000","last_undegraded":"2024-08-17T02:26:53.282807+0000","last_fullsized":"2024-08-17T02:26:53.282807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:20:15.792456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.256608+0000","last_change":"2024-08-17T02:26:52.271621+0000","last_active":"2024-08-17T02:26:53.256608+0000","last_peered":"2024-08-17T02:26:53.256608+0000","last_clean":"2024-08-17T02:26:53.256608+0000","last_became_active":"2024-08-17T02:26:52.271331+0000","last_became_peered":"2024-08-17T02:26:52.271331+0000","last_unstale":"2024-08-17T02:26:53.256608+0000","last_undegraded":"2024-08-17T02:26:53.256608+0000","last_fullsized":"2024-08-17T02:26:53.256608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:31.314471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.287087+0000","last_change":"2024-08-17T02:26:53.282257+0000","last_active":"2024-08-17T02:26:53.287087+0000","last_peered":"2024-08-17T02:26:53.287087+0000","last_clean":"2024-08-17T02:26:53.287087+0000","last_became_active":"2024-08-17T02:26:53.282005+0000","last_became_peered":"2024-08-17T02:26:53.282005+0000","last_unstale":"2024-08-17T02:26:53.287087+0000","last_undegraded":"2024-08-17T02:26:53.287087+0000","last_fullsized":"2024-08-17T02:26:53.287087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:52.242604+0000","last_clean_scrub_stamp":"2024-08-17T02:26:52.242604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:27.055938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.265488+0000","last_change":"2024-08-17T02:26:52.269060+0000","last_active":"2024-08-17T02:26:53.265488+0000","last_peered":"2024-08-17T02:26:53.265488+0000","last_clean":"2024-08-17T02:26:53.265488+0000","last_became_active":"2024-08-17T02:26:52.268730+0000","last_became_peered":"2024-08-17T02:26:52.268730+0000","last_unstale":"2024-08-17T02:26:53.265488+0000","last_undegraded":"2024-08-17T02:26:53.265488+0000","last_fullsized":"2024-08-17T02:26:53.265488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:51.235130+0000","last_clean_scrub_stamp":"2024-08-17T02:26:51.235130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:54:05.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:53.257066+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:26:53.257066+0000","last_peered":"2024-08-17T02:26:53.257066+0000","last_clean":"2024-08-17T02:26:53.257066+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:26:53.257066+0000","last_undegraded":"2024-08-17T02:26:53.257066+0000","last_fullsized":"2024-08-17T02:26:53.257066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":730587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71299999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:26:51 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.629},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.67200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.753},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.747},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:26:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":368640,"data_stored":140233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.82799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.4660000000000002,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.1960000000000002,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.44}]},{"osd":2,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.501},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.63}]},{"osd":4,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.4039999999999999,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:52 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":3.496,"5min":3.496,"15min":3.496},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":3.6110000000000002,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.68400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":364544,"data_stored":140199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":2.9020000000000001,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.314}]},{"osd":1,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.226,"5min":3.226,"15min":3.226},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.9990000000000001,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.2629999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.434}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.54300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.495},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.59999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.625}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":954368,"data_stored":730497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.312},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:53 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:57.837 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:57.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:26:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.026+0000 7f894d200640 1 Processor -- start 2024-08-17T02:26:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.027+0000 7f894d200640 1 -- start start 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8948158b60 0x7f89480abb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 0x7f89480a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f89480ac500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480aa960 con 0x7f8948158b60 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89480ab6a0 con 0x7f89480ac070 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f894d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480aa3a0 con 0x7f89480a9e20 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8948158b60 0x7f89480abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8948158b60 0x7f89480abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39712/0 (socket says 172.21.15.146:39712) 2024-08-17T02:26:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 -- 172.21.15.146:0/855268190 learned_addr learned my addr 172.21.15.146:0/855268190 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 -- 172.21.15.146:0/855268190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 msgr2=0x7f89480ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947e00640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f89480ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f893ea00640 1 --2- 172.21.15.146:0/855268190 >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 0x7f89480a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f89480ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 -- 172.21.15.146:0/855268190 >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 msgr2=0x7f89480a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.028+0000 7f8947400640 1 --2- 172.21.15.146:0/855268190 >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 0x7f89480a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.029+0000 7f8947400640 1 -- 172.21.15.146:0/855268190 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480aa680 con 0x7f8948158b60 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.029+0000 7f8947e00640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f89480ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.029+0000 7f893ea00640 1 --2- 172.21.15.146:0/855268190 >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 0x7f89480a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.029+0000 7f8947400640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8948158b60 0x7f89480abb30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f89480cc8b0 tx=0x7f89380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f807b03ba17b1a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f8946a00640 1 -- 172.21.15.146:0/855268190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893802add0 con 0x7f8948158b60 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f8946a00640 1 -- 172.21.15.146:0/855268190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938032440 con 0x7f8948158b60 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f8946a00640 1 -- 172.21.15.146:0/855268190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938032820 con 0x7f8948158b60 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 -- 172.21.15.146:0/855268190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8948158b60 msgr2=0x7f89480abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8948158b60 0x7f89480abb30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f89480cc8b0 tx=0x7f89380091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 -- 172.21.15.146:0/855268190 shutdown_connections 2024-08-17T02:26:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f89480ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 --2- 172.21.15.146:0/855268190 >> v2:172.21.15.150:3300/0 conn(0x7f89480ac070 0x7f89480a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 --2- 172.21.15.146:0/855268190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8948158b60 0x7f89480abb30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 -- 172.21.15.146:0/855268190 >> 172.21.15.146:0/855268190 conn(0x7f8948067750 msgr2=0x7f89480cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.030+0000 7f894d200640 1 -- 172.21.15.146:0/855268190 shutdown_connections 2024-08-17T02:26:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.031+0000 7f894d200640 1 -- 172.21.15.146:0/855268190 wait complete. 2024-08-17T02:26:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.032+0000 7f894d200640 1 Processor -- start 2024-08-17T02:26:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.032+0000 7f894d200640 1 -- start start 2024-08-17T02:26:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f894816d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948158b60 0x7f8948154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894816b130 con 0x7f89480ac070 2024-08-17T02:26:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894816a520 con 0x7f8948158b60 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f894d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894816a800 con 0x7f89480a9e20 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39720/0 (socket says 172.21.15.146:39720) 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 -- 172.21.15.146:0/3676620165 learned_addr learned my addr 172.21.15.146:0/3676620165 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f8947400640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f894816d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f8947e00640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948158b60 0x7f8948154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 -- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 msgr2=0x7f894816d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f894816d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 -- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948158b60 msgr2=0x7f8948154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948158b60 0x7f8948154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.033+0000 7f893ea00640 1 -- 172.21.15.146:0/3676620165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009450 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f893ea00640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f893000c880 tx=0x7f8930008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000ce10 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8930007890 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930007c10 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894816aae0 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.034+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948166e60 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.035+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894816b2a0 con 0x7f89480ac070 2024-08-17T02:26:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.036+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f89300113f0 con 0x7f89480ac070 2024-08-17T02:26:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.037+0000 7f893f400640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 0x7f8924067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.037+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8930082320 con 0x7f89480ac070 2024-08-17T02:26:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.037+0000 7f8947400640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 0x7f8924067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.038+0000 7f8947400640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 0x7f8924067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8938034000 tx=0x7f8938032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.041+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8930053f20 con 0x7f89480ac070 2024-08-17T02:26:58.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.276+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8948071050 con 0x7f89480ac070 2024-08-17T02:26:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.280+0000 7f893f400640 1 -- 172.21.15.146:0/3676620165 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8930053ab0 con 0x7f89480ac070 2024-08-17T02:26:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 msgr2=0x7f8924067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 0x7f8924067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8938034000 tx=0x7f8938032000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 msgr2=0x7f89481472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f893000c880 tx=0x7f8930008040 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 shutdown_connections 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8924065180 0x7f8924067630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89480ac070 0x7f89481472e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8948158b60 0x7f8948154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 --2- 172.21.15.146:0/3676620165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89480a9e20 0x7f894816d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 >> 172.21.15.146:0/3676620165 conn(0x7f8948067750 msgr2=0x7f8948157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.282+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 shutdown_connections 2024-08-17T02:26:58.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.283+0000 7f894d200640 1 -- 172.21.15.146:0/3676620165 wait complete. 2024-08-17T02:26:58.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.448+0000 7f35ac200640 1 Processor -- start 2024-08-17T02:26:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.448+0000 7f35ac200640 1 -- start start 2024-08-17T02:26:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35ac200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a4155a20 0x7f35a40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35ac200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35a4155df0 0x7f35a40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35ac200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a4156670 con 0x7f35a406d7f0 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35ac200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40b0350 con 0x7f35a4155a20 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35ac200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a406e5e0 con 0x7f35a4155df0 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a9800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a4155a20 0x7f35a40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35aa200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35a406d7f0 0x7f35a40ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49014/0 (socket says 172.21.15.146:49014) 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35aa200640 1 -- 172.21.15.146:0/3328247680 learned_addr learned my addr 172.21.15.146:0/3328247680 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a8e00640 1 --2- 172.21.15.146:0/3328247680 >> v2:172.21.15.150:3300/0 conn(0x7f35a4155df0 0x7f35a40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a9800640 1 -- 172.21.15.146:0/3328247680 >> v2:172.21.15.150:3300/0 conn(0x7f35a4155df0 msgr2=0x7f35a40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a9800640 1 --2- 172.21.15.146:0/3328247680 >> v2:172.21.15.150:3300/0 conn(0x7f35a4155df0 0x7f35a40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a9800640 1 -- 172.21.15.146:0/3328247680 >> v1:172.21.15.146:6789/0 conn(0x7f35a406d7f0 legacy=0x7f35a40ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a9800640 1 -- 172.21.15.146:0/3328247680 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a406e8c0 con 0x7f35a4155a20 2024-08-17T02:26:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.450+0000 7f35a3e00640 1 -- 172.21.15.146:0/3328247680 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178220705 0 0) 0x7f35a4156670 con 0x7f35a406d7f0 2024-08-17T02:26:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.451+0000 7f35a9800640 1 --2- 172.21.15.146:0/3328247680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40adf10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f35a406aa10 tx=0x7f35980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21c0b34d5da2035 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35a3e00640 1 -- 172.21.15.146:0/3328247680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359802adb0 con 0x7f35a4155a20 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35a3e00640 1 -- 172.21.15.146:0/3328247680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598032440 con 0x7f35a4155a20 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35a3e00640 1 -- 172.21.15.146:0/3328247680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980327e0 con 0x7f35a4155a20 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 -- 172.21.15.146:0/3328247680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 msgr2=0x7f35a40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 --2- 172.21.15.146:0/3328247680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40adf10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f35a406aa10 tx=0x7f35980090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 -- 172.21.15.146:0/3328247680 shutdown_connections 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 --2- 172.21.15.146:0/3328247680 >> v2:172.21.15.150:3300/0 conn(0x7f35a4155df0 0x7f35a40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 --2- 172.21.15.146:0/3328247680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40adf10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 -- 172.21.15.146:0/3328247680 >> 172.21.15.146:0/3328247680 conn(0x7f35a40cb9b0 msgr2=0x7f35a40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 -- 172.21.15.146:0/3328247680 shutdown_connections 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.452+0000 7f35ac200640 1 -- 172.21.15.146:0/3328247680 wait complete. 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.454+0000 7f35ac200640 1 Processor -- start 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.454+0000 7f35ac200640 1 -- start start 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a406d7f0 0x7f35a4167660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 0x7f35a414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cb1f0 con 0x7f35a4155a20 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4167ba0 con 0x7f35a4155df0 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35ac200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40cb440 con 0x7f35a406d7f0 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39728/0 (socket says 172.21.15.146:39728) 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 -- 172.21.15.146:0/2226128376 learned_addr learned my addr 172.21.15.146:0/2226128376 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35aa200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 0x7f35a414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a9800640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a406d7f0 0x7f35a4167660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 -- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a406d7f0 msgr2=0x7f35a4167660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a406d7f0 0x7f35a4167660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 -- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 msgr2=0x7f35a414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 0x7f35a414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35a8e00640 1 -- 172.21.15.146:0/2226128376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009390 con 0x7f35a4155a20 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.455+0000 7f35aa200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 0x7f35a414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35a8e00640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f359000d860 tx=0x7f3590008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900096a0 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590009800 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590009bc0 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40cb720 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.456+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a40a8e70 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.457+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4064db0 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.458+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3590014410 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.459+0000 7f35a0c00640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 0x7f3584067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.459+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3590082be0 con 0x7f35a4155a20 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.459+0000 7f35a9800640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 0x7f3584067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.460+0000 7f35a9800640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 0x7f3584067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f3598032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.463+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3590050cc0 con 0x7f35a4155a20 2024-08-17T02:26:58.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.669+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35a40ae360 con 0x7f35a4155a20 2024-08-17T02:26:58.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.670+0000 7f35a0c00640 1 -- 172.21.15.146:0/2226128376 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f35900542e0 con 0x7f35a4155a20 2024-08-17T02:26:58.671 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:26:58.671 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4930,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:58.671 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 17 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 msgr2=0x7f3584067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 0x7f3584067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f3598032000 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 msgr2=0x7f35a40c13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f359000d860 tx=0x7f3590008040 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 shutdown_connections 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3584065150 0x7f3584067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a4155a20 0x7f35a40c13f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35a4155df0 0x7f35a414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 --2- 172.21.15.146:0/2226128376 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35a406d7f0 0x7f35a4167660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 >> 172.21.15.146:0/2226128376 conn(0x7f35a40cb9b0 msgr2=0x7f35a4151790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:58.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 shutdown_connections 2024-08-17T02:26:58.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:58.672+0000 7f35ac200640 1 -- 172.21.15.146:0/2226128376 wait complete. 2024-08-17T02:26:59.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:52.667561+0000', 'modified': '2024-08-17T02:26:56.277620+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4956}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4956': {'gid': 4956, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/4020030705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 4020030705}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 4020030705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:59.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:59.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:26:59.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:59.229 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.244+0000 7fb304a00640 1 Processor -- start 2024-08-17T02:26:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.244+0000 7fb304a00640 1 -- start start 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb300159ca0 0x7fb3000ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ca8a0 0x7fb3000cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3000ccad0 0x7fb3000cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cd6e0 con 0x7fb3000ccad0 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000ccf70 con 0x7fb300159ca0 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb304a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000cadc0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb2ffe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3000ccad0 0x7fb3000cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb2ffe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3000ccad0 0x7fb3000cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39732/0 (socket says 172.21.15.146:39732) 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb2ff400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb300159ca0 0x7fb3000ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb2fea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ca8a0 0x7fb3000cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.245+0000 7fb2ffe00640 1 -- 172.21.15.146:0/1132764298 learned_addr learned my addr 172.21.15.146:0/1132764298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.246+0000 7fb2ffe00640 1 -- 172.21.15.146:0/1132764298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ca8a0 msgr2=0x7fb3000cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.246+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/1132764298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ca8a0 0x7fb3000cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.246+0000 7fb2ffe00640 1 -- 172.21.15.146:0/1132764298 >> v2:172.21.15.150:3300/0 conn(0x7fb300159ca0 msgr2=0x7fb3000ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.246+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/1132764298 >> v2:172.21.15.150:3300/0 conn(0x7fb300159ca0 0x7fb3000ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.246+0000 7fb2ffe00640 1 -- 172.21.15.146:0/1132764298 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000cb060 con 0x7fb3000ccad0 2024-08-17T02:26:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.247+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/1132764298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ccad0 0x7fb3000cdb30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb30008a320 tx=0x7fb2f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57623b2206a8de0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.247+0000 7fb2fe000640 1 -- 172.21.15.146:0/1132764298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8031400 con 0x7fb3000ccad0 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.247+0000 7fb2fe000640 1 -- 172.21.15.146:0/1132764298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f802d050 con 0x7fb3000ccad0 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.247+0000 7fb2fe000640 1 -- 172.21.15.146:0/1132764298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80317d0 con 0x7fb3000ccad0 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 -- 172.21.15.146:0/1132764298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ccad0 msgr2=0x7fb3000cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 --2- 172.21.15.146:0/1132764298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ccad0 0x7fb3000cdb30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb30008a320 tx=0x7fb2f8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 -- 172.21.15.146:0/1132764298 shutdown_connections 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 --2- 172.21.15.146:0/1132764298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ccad0 0x7fb3000cdb30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 --2- 172.21.15.146:0/1132764298 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ca8a0 0x7fb3000cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 --2- 172.21.15.146:0/1132764298 >> v2:172.21.15.150:3300/0 conn(0x7fb300159ca0 0x7fb3000ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 -- 172.21.15.146:0/1132764298 >> 172.21.15.146:0/1132764298 conn(0x7fb300098e00 msgr2=0x7fb30006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 -- 172.21.15.146:0/1132764298 shutdown_connections 2024-08-17T02:26:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.248+0000 7fb304a00640 1 -- 172.21.15.146:0/1132764298 wait complete. 2024-08-17T02:26:59.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.250+0000 7fb304a00640 1 Processor -- start 2024-08-17T02:26:59.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.250+0000 7fb304a00640 1 -- start start 2024-08-17T02:26:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.250+0000 7fb304a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.250+0000 7fb304a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ccad0 0x7fb300169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb304a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb300159ca0 0x7fb3000c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb304a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300155390 con 0x7fb3000ca8a0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb304a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c9bb0 con 0x7fb300159ca0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb304a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb300169b50 con 0x7fb3000ccad0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39746/0 (socket says 172.21.15.146:39746) 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 -- 172.21.15.146:0/58499173 learned_addr learned my addr 172.21.15.146:0/58499173 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb300159ca0 0x7fb3000c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2fea00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ccad0 0x7fb300169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 -- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ccad0 msgr2=0x7fb300169610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ccad0 0x7fb300169610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 -- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb300159ca0 msgr2=0x7fb3000c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb300159ca0 0x7fb3000c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.251+0000 7fb2ff400640 1 -- 172.21.15.146:0/58499173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009ae0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb2ff400640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e900 tx=0x7fb2f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb2f6a00640 1 -- 172.21.15.146:0/58499173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000c940 con 0x7fb3000ca8a0 2024-08-17T02:26:59.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb2f6a00640 1 -- 172.21.15.146:0/58499173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000cac0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000c93e0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb2f6a00640 1 -- 172.21.15.146:0/58499173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000ce80 con 0x7fb3000ca8a0 2024-08-17T02:26:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.252+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c38d0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.255+0000 7fb2f6a00640 1 -- 172.21.15.146:0/58499173 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb2f0013680 con 0x7fb3000ca8a0 2024-08-17T02:26:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.255+0000 7fb30859c740 1 Processor -- start 2024-08-17T02:26:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.255+0000 7fb2f6a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 0x7fb2e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.256+0000 7fb2f6a00640 1 -- 172.21.15.146:0/58499173 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2f00825f0 con 0x7fb3000ca8a0 2024-08-17T02:26:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.256+0000 7fb30859c740 1 -- start start 2024-08-17T02:26:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.256+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 0x7fb2e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 0x7fb2e0067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8033000 tx=0x7fb2f8034000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b12ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d8b0 0x55b87b100b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b095380 con 0x55b87b11d4e0 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b03e9e0 con 0x55b87b11d8b0 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87b03c170 con 0x55b87b0db230 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39756/0 (socket says 172.21.15.146:39756) 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2ff400640 1 -- 172.21.15.146:0/1003305729 learned_addr learned my addr 172.21.15.146:0/1003305729 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d8b0 0x55b87b100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.257+0000 7fb2fea00640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b12ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 -- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 msgr2=0x55b87b12ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b12ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 -- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d8b0 msgr2=0x55b87b100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d8b0 0x55b87b100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 -- 172.21.15.146:0/1003305729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87afeb820 con 0x55b87b11d4e0 2024-08-17T02:26:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2fea00640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b12ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:59.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0054310 tx=0x7fb2f00809d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62ec97ddaa5249c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2eb400640 1 -- 172.21.15.146:0/1003305729 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0054380 con 0x55b87b11d4e0 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2eb400640 1 -- 172.21.15.146:0/1003305729 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0057520 con 0x55b87b11d4e0 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.258+0000 7fb2eb400640 1 -- 172.21.15.146:0/1003305729 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f005b270 con 0x55b87b11d4e0 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 -- 172.21.15.146:0/1003305729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 msgr2=0x55b87b0daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0054310 tx=0x7fb2f00809d0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 -- 172.21.15.146:0/1003305729 shutdown_connections 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d8b0 0x55b87b100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b12ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 --2- 172.21.15.146:0/1003305729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b0daa80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 -- 172.21.15.146:0/1003305729 >> 172.21.15.146:0/1003305729 conn(0x55b87b073030 msgr2=0x55b87b121e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 -- 172.21.15.146:0/1003305729 shutdown_connections 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.259+0000 7fb30859c740 1 -- 172.21.15.146:0/1003305729 wait complete. 2024-08-17T02:26:59.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.260+0000 7fb30859c740 1 -- start start 2024-08-17T02:26:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.260+0000 7fb30859c740 1 Processor -- start 2024-08-17T02:26:59.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 0x55b87b104050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b107010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b037f60 con 0x55b87b11d4e0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87afe0690 con 0x55b87b0db230 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87afe0330 con 0x55b87b11d8b0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb30859c740 10 client.0 _ll_register_callbacks cb 0x55b87afda2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb2fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb2fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39762/0 (socket says 172.21.15.146:39762) 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb2fea00640 1 -- 172.21.15.146:0/236130976 learned_addr learned my addr 172.21.15.146:0/236130976 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb2ff400640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 0x55b87b104050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.261+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 -- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 msgr2=0x55b87b107010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b107010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 -- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 msgr2=0x55b87b104050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 0x55b87b104050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 -- 172.21.15.146:0/236130976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c38d0 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2ff400640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 0x55b87b104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2fea00640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3000c96e0 tx=0x7fb2ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289fa703709dbe7b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec014e60 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b87b06bd20 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2ec01a070 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2ec012ca0 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb30859c740 10 client.5145 fetch_fsmap learned FSMap version 17 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.262+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b87b001ab0 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b87b06bd20 con 0x55b87b11d4e0 2024-08-17T02:26:59.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb2ec011030 con 0x55b87b11d4e0 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 10 client.5145 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 10 client.5145 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 20 client.5145 populate_metadata read hostname 'smithi146' 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b12e390 0x55b87b12e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 4 client.5145 mds_command: new command op to 4956 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 --> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b87ad3f3c0 con 0x55b87b12e390 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.263+0000 7fb2ff400640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b12e390 0x55b87b12e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.264+0000 7fb2dfe00640 10 client.5145 ms_handle_connect on v2:172.21.15.146:6834/4020030705 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.264+0000 7fb2ff400640 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b12e390 0x55b87b12e760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c569ae3a24be10a server_cookie=237ce8f32d5056f1 in_seq=0 out_seq=0 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.264+0000 7fb2dfe00640 1 -- 172.21.15.146:0/236130976 <== mds.0 v2:172.21.15.146:6834/4020030705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55b87ad3f3c0 con 0x55b87b12e390 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.264+0000 7fb2dfe00640 10 client.5145 handle_command_reply: tid=0 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 client.5145 shutdown 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 msgr2=0x55b87b106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb3000c96e0 tx=0x7fb2ec008040 comp rx=0 tx=0).stop 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 shutdown_connections 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b12e390 0x55b87b12e760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d4e0 0x55b87b106ad0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 --2- 172.21.15.146:0/236130976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b0db230 0x55b87b104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb2dfe00640 0 client.5145 ms_handle_reset on v2:172.21.15.146:6834/4020030705 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 >> 172.21.15.146:0/236130976 conn(0x55b87b073030 msgr2=0x55b87b12c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 shutdown_connections 2024-08-17T02:26:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 1 -- 172.21.15.146:0/236130976 wait complete. 2024-08-17T02:26:59.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.265+0000 7fb30859c740 20 client.5145 trim_cache size 0 max 16384 2024-08-17T02:26:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.281+0000 7fb30859c740 1 Processor -- start 2024-08-17T02:26:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 -- start start 2024-08-17T02:26:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87adb2f20 con 0x55b87b0db230 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b1044e0 con 0x55b87b11d4e0 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.282+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87b1853a0 con 0x55b87b11d8b0 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39774/0 (socket says 172.21.15.146:39774) 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 -- 172.21.15.146:0/1336235511 learned_addr learned my addr 172.21.15.146:0/1336235511 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2fea00640 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 -- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 msgr2=0x55b87b105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 -- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 msgr2=0x55b87b104e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b104e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 -- 172.21.15.146:0/1336235511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87b005490 con 0x55b87b0db230 2024-08-17T02:26:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.283+0000 7fb2ff400640 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0050880 tx=0x7fb2f0066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9fe9397a9432e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.284+0000 7fb2ebe00640 1 -- 172.21.15.146:0/1336235511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f006e040 con 0x55b87b0db230 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.284+0000 7fb2ebe00640 1 -- 172.21.15.146:0/1336235511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f005b270 con 0x55b87b0db230 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.284+0000 7fb2ebe00640 1 -- 172.21.15.146:0/1336235511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0054380 con 0x55b87b0db230 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- 172.21.15.146:0/1336235511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 msgr2=0x55b87b184e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0050880 tx=0x7fb2f0066000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- 172.21.15.146:0/1336235511 shutdown_connections 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b11d8b0 0x55b87b105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 --2- 172.21.15.146:0/1336235511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b0db230 0x55b87b184e60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- 172.21.15.146:0/1336235511 >> 172.21.15.146:0/1336235511 conn(0x55b87b073030 msgr2=0x55b87b12be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- 172.21.15.146:0/1336235511 shutdown_connections 2024-08-17T02:26:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- 172.21.15.146:0/1336235511 wait complete. 2024-08-17T02:26:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.285+0000 7fb30859c740 1 -- start start 2024-08-17T02:26:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 Processor -- start 2024-08-17T02:26:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b182bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b103230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b143270 con 0x55b87b11d8b0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87b18e4d0 con 0x55b87b11d4e0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.286+0000 7fb30859c740 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b87b12f980 con 0x55b87b0db230 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb30859c740 10 client.0 _ll_register_callbacks cb 0x7fb2ec009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ff400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b182bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39786/0 (socket says 172.21.15.146:39786) 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 -- 172.21.15.146:0/657965845 learned_addr learned my addr 172.21.15.146:0/657965845 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2fea00640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 -- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 msgr2=0x55b87b182bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b182bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 -- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 msgr2=0x55b87b103230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b103230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.287+0000 7fb2ffe00640 1 -- 172.21.15.146:0/657965845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b87afeb820 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2ffe00640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2f804a6a0 tx=0x7fb2f803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e7f28648296106 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f804f050 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2f8043070 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2f0057520 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2f8055670 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 10 client.5151 fetch_fsmap learned FSMap version 17 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b87b0051e0 con 0x55b87b11d8b0 2024-08-17T02:26:59.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0057520 con 0x55b87b11d8b0 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb2f8046040 con 0x55b87b11d8b0 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 10 client.5151 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 10 client.5151 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 20 client.5151 populate_metadata read hostname 'smithi146' 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b103830 0x55b87b105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 4 client.5151 mds_command: new command op to 4956 tid=0[{"prefix": "status"}] 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.288+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 --> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b87ad506c0 con 0x55b87b103830 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb2ff400640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b103830 0x55b87b105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb2ff400640 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b103830 0x55b87b105380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e4a1483ca12f31 server_cookie=10b4b4694c9189a in_seq=0 out_seq=0 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb2dfe00640 10 client.5151 ms_handle_connect on v2:172.21.15.146:6834/4020030705 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb2dfe00640 1 -- 172.21.15.146:0/657965845 <== mds.0 v2:172.21.15.146:6834/4020030705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b87ad506c0 con 0x55b87b103830 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb2dfe00640 10 client.5151 handle_command_reply: tid=0 2024-08-17T02:26:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.289+0000 7fb30859c740 1 client.5151 shutdown 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 msgr2=0x55b87b104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb2f804a6a0 tx=0x7fb2f803f070 comp rx=0 tx=0).stop 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 shutdown_connections 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:6834/4020030705,v1:172.21.15.146:6835/4020030705] conn(0x55b87b103830 0x55b87b105380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b87b11d8b0 0x55b87b104e40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b87b11d4e0 0x55b87b103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 --2- 172.21.15.146:0/657965845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b87b0db230 0x55b87b182bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb2dfe00640 0 client.5151 ms_handle_reset on v2:172.21.15.146:6834/4020030705 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 >> 172.21.15.146:0/657965845 conn(0x55b87b073030 msgr2=0x55b87b12c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 shutdown_connections 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 1 -- 172.21.15.146:0/657965845 wait complete. 2024-08-17T02:26:59.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb30859c740 20 client.5151 trim_cache size 0 max 16384 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "955175c7-decf-4b1d-aa3f-b20724739e7d", 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4956, 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 6.024654849, 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 17, 2024-08-17T02:26:59.295 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 32, 2024-08-17T02:26:59.296 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:26:59.296 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.865782102000001 2024-08-17T02:26:59.296 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.290+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 msgr2=0x7fb2e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 0x7fb2e0067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8033000 tx=0x7fb2f8034000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 msgr2=0x7fb300154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e900 tx=0x7fb2f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 shutdown_connections 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb2e0065150 0x7fb2e0067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb300159ca0 0x7fb3000c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3000ccad0 0x7fb300169610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 --2- 172.21.15.146:0/58499173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000ca8a0 0x7fb300154e50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 >> 172.21.15.146:0/58499173 conn(0x7fb300098e00 msgr2=0x7fb300155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 shutdown_connections 2024-08-17T02:26:59.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.291+0000 7fb304a00640 1 -- 172.21.15.146:0/58499173 wait complete. 2024-08-17T02:26:59.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.498+0000 7f89f3200640 1 Processor -- start 2024-08-17T02:26:59.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.498+0000 7f89f3200640 1 -- start start 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f3200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89f4159ca0 0x7f89f40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f3200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f40cadc0 con 0x7f89f40ccca0 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f3200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f40cb060 con 0x7f89f40ca8a0 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f3200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f40cd6e0 con 0x7f89f4159ca0 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f2800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89f40ccca0 0x7f89f4162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49024/0 (socket says 172.21.15.146:49024) 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.499+0000 7f89f2800640 1 -- 172.21.15.146:0/2667806056 learned_addr learned my addr 172.21.15.146:0/2667806056 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:26:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f1e00640 1 --2- 172.21.15.146:0/2667806056 >> v2:172.21.15.150:3300/0 conn(0x7f89f4159ca0 0x7f89f40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f0a00640 1 -- 172.21.15.146:0/2667806056 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710271041 0 0) 0x7f89f40cadc0 con 0x7f89f40ccca0 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f0a00640 1 -- 172.21.15.146:0/2667806056 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d80034e0 con 0x7f89f40ccca0 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f1e00640 1 -- 172.21.15.146:0/2667806056 >> v1:172.21.15.150:6789/0 conn(0x7f89f40ca8a0 legacy=0x7f89f40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f1e00640 1 -- 172.21.15.146:0/2667806056 >> v1:172.21.15.146:6789/0 conn(0x7f89f40ccca0 legacy=0x7f89f4162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.500+0000 7f89f1e00640 1 -- 172.21.15.146:0/2667806056 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40cb300 con 0x7f89f4159ca0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.501+0000 7f89f1e00640 1 --2- 172.21.15.146:0/2667806056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f4159ca0 0x7f89f40ca360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009850 tx=0x7f89e40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa9c8d996dbfa05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.501+0000 7f89f0a00640 1 -- 172.21.15.146:0/2667806056 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e402ae20 con 0x7f89f4159ca0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.501+0000 7f89f0a00640 1 -- 172.21.15.146:0/2667806056 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e4032440 con 0x7f89f4159ca0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.501+0000 7f89f0a00640 1 -- 172.21.15.146:0/2667806056 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40327e0 con 0x7f89f4159ca0 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 -- 172.21.15.146:0/2667806056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f4159ca0 msgr2=0x7f89f40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 --2- 172.21.15.146:0/2667806056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f4159ca0 0x7f89f40ca360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009850 tx=0x7f89e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 -- 172.21.15.146:0/2667806056 shutdown_connections 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 --2- 172.21.15.146:0/2667806056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f4159ca0 0x7f89f40ca360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 -- 172.21.15.146:0/2667806056 >> 172.21.15.146:0/2667806056 conn(0x7f89f4098e00 msgr2=0x7f89f406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 -- 172.21.15.146:0/2667806056 shutdown_connections 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.502+0000 7f89f3200640 1 -- 172.21.15.146:0/2667806056 wait complete. 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.503+0000 7f89f3200640 1 Processor -- start 2024-08-17T02:26:59.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 -- start start 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40ca8a0 0x7f89f409a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 0x7f89f40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40c3610 con 0x7f89f40ccca0 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f409b900 con 0x7f89f40ca8a0 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.504+0000 7f89f3200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f409acf0 con 0x7f89f4159ca0 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39790/0 (socket says 172.21.15.146:39790) 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 -- 172.21.15.146:0/2118557501 learned_addr learned my addr 172.21.15.146:0/2118557501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1e00640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40ca8a0 0x7f89f409a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f2800640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 0x7f89f40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 -- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 msgr2=0x7f89f40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 0x7f89f40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 -- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40ca8a0 msgr2=0x7f89f409a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40ca8a0 0x7f89f409a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 -- 172.21.15.146:0/2118557501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4009390 con 0x7f89f40ccca0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f2800640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 0x7f89f40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.505+0000 7f89f1400640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c560 tx=0x7f89e0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.506+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011590 con 0x7f89f40ccca0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.506+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0011710 con 0x7f89f40ccca0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.506+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011ad0 con 0x7f89f40ccca0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.506+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f409afd0 con 0x7f89f40ccca0 2024-08-17T02:26:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.506+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f409b590 con 0x7f89f40ccca0 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.507+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4071050 con 0x7f89f40ccca0 2024-08-17T02:26:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.508+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f89e001b3b0 con 0x7f89f40ccca0 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.509+0000 7f89e9600640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 0x7f89d4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.509+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89e0081a10 con 0x7f89f40ccca0 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.509+0000 7f89f1e00640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 0x7f89d4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.510+0000 7f89f1e00640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 0x7f89d4067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89e4034000 tx=0x7f89e4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:59.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.512+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f89e004fa30 con 0x7f89f40ccca0 2024-08-17T02:26:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.719+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89f415ae00 con 0x7f89f40ccca0 2024-08-17T02:26:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.719+0000 7f89e9600640 1 -- 172.21.15.146:0/2118557501 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89e0017070 con 0x7f89f40ccca0 2024-08-17T02:26:59.720 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 msgr2=0x7f89d4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 0x7f89d4067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89e4034000 tx=0x7f89e4032000 comp rx=0 tx=0).stop 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 msgr2=0x7f89f414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c560 tx=0x7f89e0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 shutdown_connections 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f89d4065180 0x7f89d4067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f40ccca0 0x7f89f414ced0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89f4159ca0 0x7f89f40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.721+0000 7f89f3200640 1 --2- 172.21.15.146:0/2118557501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89f40ca8a0 0x7f89f409a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.722+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 >> 172.21.15.146:0/2118557501 conn(0x7f89f4098e00 msgr2=0x7f89f4156dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.722+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 shutdown_connections 2024-08-17T02:26:59.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:26:59.722+0000 7f89f3200640 1 -- 172.21.15.146:0/2118557501 wait complete. 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:26:59.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:26:59.738 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:59.738 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:59.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.738 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-08-17T02:26:59.775 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ae:60:3c:45:b9:04 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:59.776 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1c02:d4ff:fe24:9cf/64 scope link 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ce:cd:af:7e:d9:b3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::cccd:afff:fe7e:d9b3/64 scope link 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether ae:60:3c:45:b9:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ac60:3cff:fe45:b904/64 scope link 2024-08-17T02:26:59.777 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:59.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.778 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:59.868 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-08-17T02:26:59.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.872 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-08-17T02:26:59.908 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-08-17T02:26:59.908 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:59.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:59.909 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2024-08-17T02:26:59.909 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-08-17T02:26:59.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:59.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:59.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:59.910 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-08-17T02:27:00.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:00.055 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:27:00.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:00.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:27:00.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:00.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:00.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-08-17T02:27:00.187 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:00.187 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:00.222 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:00.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:00.223 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:00.299 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:27:00.299 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:00.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:00.423 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:00.423 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:27:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with new device syntax: 0@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:27:00.450 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:00.452 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:00.455 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:00.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:00.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:00.512 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:00.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.659+0000 7fba5cc00640 1 Processor -- start 2024-08-17T02:27:00.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.659+0000 7fba5cc00640 1 -- start start 2024-08-17T02:27:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba5cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba580cbea0 0x7fba58156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba5cc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba5806dc80 0x7fba581577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba5cc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba580cc2d0 con 0x7fba58156ad0 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba5cc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba580ca900 con 0x7fba5806dc80 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba5cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba580cc560 con 0x7fba580cbea0 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba5806dc80 0x7fba581577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fba58156ad0 0x7fba5806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49040/0 (socket says 172.21.15.146:49040) 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57400640 1 -- 172.21.15.146:0/2647040889 learned_addr learned my addr 172.21.15.146:0/2647040889 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba4fe00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba580cbea0 0x7fba58156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57e00640 1 -- 172.21.15.146:0/2647040889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba580cbea0 msgr2=0x7fba58156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57e00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba580cbea0 0x7fba58156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57e00640 1 -- 172.21.15.146:0/2647040889 >> v1:172.21.15.146:6789/0 conn(0x7fba58156ad0 legacy=0x7fba5806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.661+0000 7fba57e00640 1 -- 172.21.15.146:0/2647040889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580caaf0 con 0x7fba5806dc80 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.662+0000 7fba57e00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba581577f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fba50009e90 tx=0x7fba50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3251a79a5710ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba56a00640 1 -- 172.21.15.146:0/2647040889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50007550 con 0x7fba5806dc80 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba56a00640 1 -- 172.21.15.146:0/2647040889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5002d050 con 0x7fba5806dc80 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba56a00640 1 -- 172.21.15.146:0/2647040889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50007920 con 0x7fba5806dc80 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 -- 172.21.15.146:0/2647040889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 msgr2=0x7fba581577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba581577f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fba50009e90 tx=0x7fba50009780 comp rx=0 tx=0).stop 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 -- 172.21.15.146:0/2647040889 shutdown_connections 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba581577f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 --2- 172.21.15.146:0/2647040889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba580cbea0 0x7fba58156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 -- 172.21.15.146:0/2647040889 >> 172.21.15.146:0/2647040889 conn(0x7fba58067750 msgr2=0x7fba580cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 -- 172.21.15.146:0/2647040889 shutdown_connections 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.663+0000 7fba5cc00640 1 -- 172.21.15.146:0/2647040889 wait complete. 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.665+0000 7fba5cc00640 1 Processor -- start 2024-08-17T02:27:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.665+0000 7fba5cc00640 1 -- start start 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 0x7fba580c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 0x7fba581543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58169ff0 con 0x7fba5806dc80 2024-08-17T02:27:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5813eab0 con 0x7fba580cbea0 2024-08-17T02:27:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba5cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5814f560 con 0x7fba58156ad0 2024-08-17T02:27:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba57400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba57400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39808/0 (socket says 172.21.15.146:39808) 2024-08-17T02:27:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba57400640 1 -- 172.21.15.146:0/467716945 learned_addr learned my addr 172.21.15.146:0/467716945 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba57e00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 0x7fba581543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba57400640 1 -- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 msgr2=0x7fba581543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.666+0000 7fba4fe00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 0x7fba580c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57400640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 0x7fba581543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57400640 1 -- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 msgr2=0x7fba580c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57400640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 0x7fba580c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57400640 1 -- 172.21.15.146:0/467716945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009a20 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57e00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 0x7fba581543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba4fe00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 0x7fba580c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba57400640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba4800c590 tx=0x7fba48007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48005aa0 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48005c60 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba480070d0 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5813f5b0 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.667+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5813fb70 con 0x7fba5806dc80 2024-08-17T02:27:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.668+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba58071050 con 0x7fba5806dc80 2024-08-17T02:27:00.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.669+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fba48007500 con 0x7fba5806dc80 2024-08-17T02:27:00.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.670+0000 7fba4ea00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 0x7fba34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:00.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.670+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba480819c0 con 0x7fba5806dc80 2024-08-17T02:27:00.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.670+0000 7fba4fe00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 0x7fba34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.670+0000 7fba4fe00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 0x7fba34067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba5815db30 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:00.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.673+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fba4804f9e0 con 0x7fba5806dc80 2024-08-17T02:27:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.885+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba580650c0 con 0x7fba5806dc80 2024-08-17T02:27:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.886+0000 7fba4ea00640 1 -- 172.21.15.146:0/467716945 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba48017070 con 0x7fba5806dc80 2024-08-17T02:27:00.886 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 msgr2=0x7fba34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 0x7fba34067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba5815db30 tx=0x7fba40008040 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 msgr2=0x7fba58169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba4800c590 tx=0x7fba48007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 shutdown_connections 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fba34065150 0x7fba34067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba58156ad0 0x7fba581543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba580cbea0 0x7fba580c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 --2- 172.21.15.146:0/467716945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba5806dc80 0x7fba58169ab0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 >> 172.21.15.146:0/467716945 conn(0x7fba58067750 msgr2=0x7fba580696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 shutdown_connections 2024-08-17T02:27:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:00.888+0000 7fba5cc00640 1 -- 172.21.15.146:0/467716945 wait complete. 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:00.906 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:00.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:00.907 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-08-17T02:27:00.943 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:00.944 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42566sec preferred_lft 42566sec 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether ae:f6:66:21:1d:b5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::fc85:d5ff:fe83:c4c0/64 scope link 2024-08-17T02:27:00.945 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether ae:f6:66:21:1d:b5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::acf6:66ff:fe21:1db5/64 scope link 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether e6:dd:3a:f9:46:96 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::e4dd:3aff:fef9:4696/64 scope link 2024-08-17T02:27:00.946 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:00.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:00.947 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:01.042 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-08-17T02:27:01.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:01.045 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-08-17T02:27:01.081 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-08-17T02:27:01.081 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:01.081 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:01.081 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:27:01.081 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:01.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:01.082 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-08-17T02:27:01.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:01.231 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:01.266 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:27:01.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:01.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:01.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-08-17T02:27:01.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:01.366 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:01.405 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:01.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:01.405 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:01.481 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:27:01.481 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:01.482 DEBUG:teuthology.orchestra.run.smithi150:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:01.606 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:01.606 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:01.633 INFO:teuthology.orchestra.run.smithi150.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:01.633 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:01.633 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.150:3300,172.21.15.150:3301" 2024-08-17T02:27:01.633 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: trying mount with new device syntax: 1@955175c7-decf-4b1d-aa3f-b20724739e7d.cephfs=/ 2024-08-17T02:27:01.633 INFO:teuthology.orchestra.run.smithi150.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.146:3300/172.21.15.150:3300/172.21.15.150:3301" will pass to kernel 2024-08-17T02:27:01.635 INFO:teuthology.orchestra.run.smithi150.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:27:01.635 INFO:teuthology.orchestra.run.smithi150.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:01.635 INFO:teuthology.orchestra.run.smithi150.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:01.635 INFO:teuthology.orchestra.run.smithi150.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:01.635 INFO:teuthology.orchestra.run.smithi150.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:01.638 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:01.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:01.639 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:01.695 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:27:01.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.854+0000 7fceed400640 1 Processor -- start 2024-08-17T02:27:01.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.854+0000 7fceed400640 1 -- start start 2024-08-17T02:27:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.855+0000 7fceed400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcee8151480 0x7fcee80aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.855+0000 7fceed400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee80aade0 0x7fcee80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.855+0000 7fceed400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80abf10 con 0x7fcee80acb40 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.855+0000 7fceed400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee80b09a0 con 0x7fcee8151480 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.855+0000 7fceed400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80acfc0 con 0x7fcee80aade0 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcee8151480 0x7fcee80aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee5e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee80aade0 0x7fcee80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee7200640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcee80acb40 0x7fcee80ad3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:59594/0 (socket says 172.21.15.146:59594) 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee7200640 1 -- 172.21.15.146:0/3910566489 learned_addr learned my addr 172.21.15.146:0/3910566489 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcee8151480 0x7fcee80aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.146:49774/0 (socket says 172.21.15.146:49774) 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 -- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee80aade0 msgr2=0x7fcee80ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 --2- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee80aade0 0x7fcee80ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 -- 172.21.15.146:0/3910566489 >> v1:172.21.15.150:6789/0 conn(0x7fcee80acb40 legacy=0x7fcee80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.856+0000 7fcee6800640 1 -- 172.21.15.146:0/3910566489 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee80ab300 con 0x7fcee8151480 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.857+0000 7fcee6800640 1 --2- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee8151480 0x7fcee80aa8a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fced8009850 tx=0x7fced80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a71db77f838001f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.857+0000 7fcee5400640 1 -- 172.21.15.146:0/3910566489 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced802ad00 con 0x7fcee8151480 2024-08-17T02:27:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.857+0000 7fcee5400640 1 -- 172.21.15.146:0/3910566489 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced802ae60 con 0x7fcee8151480 2024-08-17T02:27:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.857+0000 7fcee5400640 1 -- 172.21.15.146:0/3910566489 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8032670 con 0x7fcee8151480 2024-08-17T02:27:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 -- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee8151480 msgr2=0x7fcee80aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 --2- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee8151480 0x7fcee80aa8a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fced8009850 tx=0x7fced80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 -- 172.21.15.146:0/3910566489 shutdown_connections 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 --2- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee80aade0 0x7fcee80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 --2- 172.21.15.146:0/3910566489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee8151480 0x7fcee80aa8a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 -- 172.21.15.146:0/3910566489 >> 172.21.15.146:0/3910566489 conn(0x7fcee8096a70 msgr2=0x7fcee8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 -- 172.21.15.146:0/3910566489 shutdown_connections 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.858+0000 7fceed400640 1 -- 172.21.15.146:0/3910566489 wait complete. 2024-08-17T02:27:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.859+0000 7fceed400640 1 Processor -- start 2024-08-17T02:27:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.859+0000 7fceed400640 1 -- start start 2024-08-17T02:27:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee80acb40 0x7fcee8150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 0x7fcee8150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee815bbf0 con 0x7fcee80aade0 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8148bf0 con 0x7fcee80acb40 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fceed400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee814a4e0 con 0x7fcee8151480 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.860+0000 7fcee6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39810/0 (socket says 172.21.15.146:39810) 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 -- 172.21.15.146:0/1806253403 learned_addr learned my addr 172.21.15.146:0/1806253403 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee7200640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 0x7fcee8150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee5e00640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee80acb40 0x7fcee8150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 -- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 msgr2=0x7fcee8150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 0x7fcee8150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 -- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee80acb40 msgr2=0x7fcee8150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee80acb40 0x7fcee8150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 -- 172.21.15.146:0/1806253403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8009390 con 0x7fcee80aade0 2024-08-17T02:27:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee7200640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 0x7fcee8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcee6800640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced8009360 tx=0x7fced8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.861+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced803c750 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.862+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced803c8b0 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.862+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced803cc50 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.862+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee814a7c0 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.862+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee814ad80 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.863+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee80710c0 con 0x7fcee80aade0 2024-08-17T02:27:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.863+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fced8044030 con 0x7fcee80aade0 2024-08-17T02:27:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.864+0000 7fcede000640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 0x7fcec8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.864+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fced8042070 con 0x7fcee80aade0 2024-08-17T02:27:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.864+0000 7fcee5e00640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 0x7fcec8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.865+0000 7fcee5e00640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 0x7fcec8067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcee809bbf0 tx=0x7fced40090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:01.868+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fced8070ee0 con 0x7fcee80aade0 2024-08-17T02:27:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.079+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcee814c660 con 0x7fcee80aade0 2024-08-17T02:27:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.314+0000 7fcede000640 1 -- 172.21.15.146:0/1806253403 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fced80370c0 con 0x7fcee80aade0 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 msgr2=0x7fcec8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 0x7fcec8067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcee809bbf0 tx=0x7fced40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 msgr2=0x7fcee81486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fced8009360 tx=0x7fced8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 shutdown_connections 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fcec8065150 0x7fcec8067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcee8151480 0x7fcee8150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcee80acb40 0x7fcee8150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 --2- 172.21.15.146:0/1806253403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcee80aade0 0x7fcee81486b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.316+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 >> 172.21.15.146:0/1806253403 conn(0x7fcee8096a70 msgr2=0x7fcee8096e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.317+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 shutdown_connections 2024-08-17T02:27:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.317+0000 7fceed400640 1 -- 172.21.15.146:0/1806253403 wait complete. 2024-08-17T02:27:02.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:02.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.482+0000 7fc5bf000640 1 Processor -- start 2024-08-17T02:27:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.482+0000 7fc5bf000640 1 -- start start 2024-08-17T02:27:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.483+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b80af6d0 0x7fc5b80aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.483+0000 7fc5bf000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc5b80ac820 0x7fc5b8159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.483+0000 7fc5bf000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b80abc80 con 0x7fc5b8158cb0 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.483+0000 7fc5bf000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80aae50 con 0x7fc5b80ac820 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.483+0000 7fc5bf000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80afb20 con 0x7fc5b80af6d0 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5b7e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc5b8158cb0 0x7fc5b80ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49046/0 (socket says 172.21.15.146:49046) 2024-08-17T02:27:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5b7e00640 1 -- 172.21.15.146:0/4027157736 learned_addr learned my addr 172.21.15.146:0/4027157736 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5bd000640 1 --2- 172.21.15.146:0/4027157736 >> v2:172.21.15.150:3300/0 conn(0x7fc5b80ac820 0x7fc5b8159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5afe00640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b80af6d0 0x7fc5b80aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5b7400640 1 -- 172.21.15.146:0/4027157736 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385720886 0 0) 0x7fc5b80abc80 con 0x7fc5b8158cb0 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5b7400640 1 -- 172.21.15.146:0/4027157736 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc59c0034e0 con 0x7fc5b8158cb0 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5bd000640 1 -- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b80af6d0 msgr2=0x7fc5b80aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5bd000640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b80af6d0 0x7fc5b80aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5bd000640 1 -- 172.21.15.146:0/4027157736 >> v1:172.21.15.146:6789/0 conn(0x7fc5b8158cb0 legacy=0x7fc5b80ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.484+0000 7fc5bd000640 1 -- 172.21.15.146:0/4027157736 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80ab070 con 0x7fc5b80ac820 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.485+0000 7fc5bd000640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8159080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009e60 tx=0x7fc5b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb3e583f0731930f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5b7400640 1 -- 172.21.15.146:0/4027157736 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0007550 con 0x7fc5b80ac820 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5b7400640 1 -- 172.21.15.146:0/4027157736 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b002d050 con 0x7fc5b80ac820 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5b7400640 1 -- 172.21.15.146:0/4027157736 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0007920 con 0x7fc5b80ac820 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 -- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 msgr2=0x7fc5b8159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8159080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009e60 tx=0x7fc5b0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 -- 172.21.15.146:0/4027157736 shutdown_connections 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8159080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 --2- 172.21.15.146:0/4027157736 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b80af6d0 0x7fc5b80aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.486+0000 7fc5bf000640 1 -- 172.21.15.146:0/4027157736 >> 172.21.15.146:0/4027157736 conn(0x7fc5b8096a70 msgr2=0x7fc5b8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.487+0000 7fc5bf000640 1 -- 172.21.15.146:0/4027157736 shutdown_connections 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.487+0000 7fc5bf000640 1 -- 172.21.15.146:0/4027157736 wait complete. 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.488+0000 7fc5bf000640 1 Processor -- start 2024-08-17T02:27:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.488+0000 7fc5bf000640 1 -- start start 2024-08-17T02:27:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b8158cb0 0x7fc5b8097980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8155da0 con 0x7fc5b80af6d0 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80b2710 con 0x7fc5b80ac820 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bf000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80b3260 con 0x7fc5b8158cb0 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5afe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39814/0 (socket says 172.21.15.146:39814) 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5afe00640 1 -- 172.21.15.146:0/1231016439 learned_addr learned my addr 172.21.15.146:0/1231016439 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5bd000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b8158cb0 0x7fc5b8097980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.489+0000 7fc5b7e00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 -- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b8158cb0 msgr2=0x7fc5b8097980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b8158cb0 0x7fc5b8097980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 -- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 msgr2=0x7fc5b8155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 -- 172.21.15.146:0/1231016439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0009a20 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5afe00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000ea50 tx=0x7fc5a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000ca10 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000cb70 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0013470 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b80b3750 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.490+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b80b2ef0 con 0x7fc5b80af6d0 2024-08-17T02:27:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.491+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b8064db0 con 0x7fc5b80af6d0 2024-08-17T02:27:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.492+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc5a0013860 con 0x7fc5b80af6d0 2024-08-17T02:27:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.493+0000 7fc5af400640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 0x7fc594067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.493+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5a0082770 con 0x7fc5b80af6d0 2024-08-17T02:27:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.493+0000 7fc5b7e00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 0x7fc594067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.494+0000 7fc5b7e00640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 0x7fc594067630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005840 tx=0x7fc5a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.497+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc5a0050900 con 0x7fc5b80af6d0 2024-08-17T02:27:02.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.694+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b80b33a0 con 0x7fc594065180 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.696+0000 7fc5af400640 1 -- 172.21.15.146:0/1231016439 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc5b80b33a0 con 0x7fc594065180 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: "name": "cephfs" 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:27:02.696 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-08-17T02:27:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 msgr2=0x7fc594067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 0x7fc594067630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005840 tx=0x7fc5a8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 msgr2=0x7fc5b8154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000ea50 tx=0x7fc5a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 shutdown_connections 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc594065180 0x7fc594067630 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b80af6d0 0x7fc5b8154c00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc5b8158cb0 0x7fc5b8097980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 --2- 172.21.15.146:0/1231016439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5b80ac820 0x7fc5b8155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 >> 172.21.15.146:0/1231016439 conn(0x7fc5b8096a70 msgr2=0x7fc5b806a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 shutdown_connections 2024-08-17T02:27:02.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.698+0000 7fc5bf000640 1 -- 172.21.15.146:0/1231016439 wait complete. 2024-08-17T02:27:02.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:02.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.867+0000 7fd5afa00640 1 Processor -- start 2024-08-17T02:27:02.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.867+0000 7fd5afa00640 1 -- start start 2024-08-17T02:27:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5afa00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5a8069a60 0x7fd5a8069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5afa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5afa00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a806d470 con 0x7fd5a80c7e50 2024-08-17T02:27:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5afa00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a80aec60 con 0x7fd5a8069a60 2024-08-17T02:27:02.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5afa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a806c860 con 0x7fd5a8155550 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5ada00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.868+0000 7fd5ad000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5a8069a60 0x7fd5a8069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:49870/0 (socket says 172.21.15.146:49870) 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 -- 172.21.15.146:0/417125200 learned_addr learned my addr 172.21.15.146:0/417125200 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5a7e00640 1 --1- 172.21.15.146:0/417125200 >> v1:172.21.15.150:6789/0 conn(0x7fd5a80c7e50 0x7fd5a8154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:59604/0 (socket says 172.21.15.146:59604) 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 -- 172.21.15.146:0/417125200 >> v2:172.21.15.150:3300/0 conn(0x7fd5a8069a60 msgr2=0x7fd5a8069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 --2- 172.21.15.146:0/417125200 >> v2:172.21.15.150:3300/0 conn(0x7fd5a8069a60 0x7fd5a8069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 -- 172.21.15.146:0/417125200 >> v1:172.21.15.150:6789/0 conn(0x7fd5a80c7e50 legacy=0x7fd5a8154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.869+0000 7fd5ada00640 1 -- 172.21.15.146:0/417125200 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a806cb40 con 0x7fd5a8155550 2024-08-17T02:27:02.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.870+0000 7fd5ada00640 1 --2- 172.21.15.146:0/417125200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009f20 tx=0x7fd5a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a99cc68640eeca5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.870+0000 7fd5a7400640 1 -- 172.21.15.146:0/417125200 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0031400 con 0x7fd5a8155550 2024-08-17T02:27:02.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.870+0000 7fd5a7400640 1 -- 172.21.15.146:0/417125200 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a002d050 con 0x7fd5a8155550 2024-08-17T02:27:02.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.870+0000 7fd5a7400640 1 -- 172.21.15.146:0/417125200 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00317d0 con 0x7fd5a8155550 2024-08-17T02:27:02.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 -- 172.21.15.146:0/417125200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 msgr2=0x7fd5a806a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 --2- 172.21.15.146:0/417125200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009f20 tx=0x7fd5a0009840 comp rx=0 tx=0).stop 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 -- 172.21.15.146:0/417125200 shutdown_connections 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 --2- 172.21.15.146:0/417125200 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a806a590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 --2- 172.21.15.146:0/417125200 >> v2:172.21.15.150:3300/0 conn(0x7fd5a8069a60 0x7fd5a8069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 -- 172.21.15.146:0/417125200 >> 172.21.15.146:0/417125200 conn(0x7fd5a8067750 msgr2=0x7fd5a80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 -- 172.21.15.146:0/417125200 shutdown_connections 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.871+0000 7fd5afa00640 1 -- 172.21.15.146:0/417125200 wait complete. 2024-08-17T02:27:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.872+0000 7fd5afa00640 1 Processor -- start 2024-08-17T02:27:02.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.873+0000 7fd5afa00640 1 -- start start 2024-08-17T02:27:02.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8069a60 0x7fd5a8144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a8148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8144670 con 0x7fd5a80c7e50 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8143a60 con 0x7fd5a8069a60 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5afa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a8143d40 con 0x7fd5a8155550 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39826/0 (socket says 172.21.15.146:39826) 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 -- 172.21.15.146:0/1305746817 learned_addr learned my addr 172.21.15.146:0/1305746817 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5ada00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a8148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5ad000640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8069a60 0x7fd5a8144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 -- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 msgr2=0x7fd5a8148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a8148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 -- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8069a60 msgr2=0x7fd5a8144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8069a60 0x7fd5a8144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.874+0000 7fd5a7e00640 1 -- 172.21.15.146:0/1305746817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0009ae0 con 0x7fd5a80c7e50 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd5a7e00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c590 tx=0x7fd594007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594007300 con 0x7fd5a80c7e50 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940074a0 con 0x7fd5a80c7e50 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a8144020 con 0x7fd5a80c7e50 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5940047a0 con 0x7fd5a80c7e50 2024-08-17T02:27:02.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.875+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a8145040 con 0x7fd5a80c7e50 2024-08-17T02:27:02.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.876+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a8144820 con 0x7fd5a80c7e50 2024-08-17T02:27:02.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.877+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd594004bd0 con 0x7fd5a80c7e50 2024-08-17T02:27:02.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.878+0000 7fd59be00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 0x7fd588067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.878+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd594081870 con 0x7fd5a80c7e50 2024-08-17T02:27:02.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.878+0000 7fd5ad000640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 0x7fd588067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.879+0000 7fd5ad000640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 0x7fd588067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5a81460a0 tx=0x7fd59c0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:02.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:02.882+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd5a8144820 con 0x7fd5a80c7e50 2024-08-17T02:27:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.054+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd5a8071050 con 0x7fd5a80c7e50 2024-08-17T02:27:03.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.055+0000 7fd59be00640 1 -- 172.21.15.146:0/1305746817 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd594053450 con 0x7fd5a80c7e50 2024-08-17T02:27:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 msgr2=0x7fd588067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 0x7fd588067630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5a81460a0 tx=0x7fd59c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 msgr2=0x7fd5a8149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c590 tx=0x7fd594007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 shutdown_connections 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd588065180 0x7fd588067630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80c7e50 0x7fd5a8149b10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5a8155550 0x7fd5a8148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 --2- 172.21.15.146:0/1305746817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5a8069a60 0x7fd5a8144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 >> 172.21.15.146:0/1305746817 conn(0x7fd5a8067750 msgr2=0x7fd5a80c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 shutdown_connections 2024-08-17T02:27:03.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.057+0000 7fd5afa00640 1 -- 172.21.15.146:0/1305746817 wait complete. 2024-08-17T02:27:03.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001039307 2024-08-17T02:27:03.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.223+0000 7f8019000640 1 Processor -- start 2024-08-17T02:27:03.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.223+0000 7f8019000640 1 -- start start 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.224+0000 7f8019000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 0x7f80140b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.224+0000 7f8019000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8014156d60 0x7f80140b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.224+0000 7f8019000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801415b030 con 0x7f80140ad7b0 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.224+0000 7f8019000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140af950 con 0x7f8014156d60 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.224+0000 7f8019000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140cc2e0 con 0x7f8014156990 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8014156d60 0x7f80140b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8012800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f80140ad7b0 0x7f801406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49052/0 (socket says 172.21.15.146:49052) 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8012800640 1 -- 172.21.15.146:0/2074452378 learned_addr learned my addr 172.21.15.146:0/2074452378 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:03.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8014156d60 0x7f80140b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39832/0 (socket says 172.21.15.146:39832) 2024-08-17T02:27:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 -- 172.21.15.146:0/2074452378 >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 msgr2=0x7f80140b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011e00640 1 --2- 172.21.15.146:0/2074452378 >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 0x7f80140b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 --2- 172.21.15.146:0/2074452378 >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 0x7f80140b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 -- 172.21.15.146:0/2074452378 >> v1:172.21.15.146:6789/0 conn(0x7f80140ad7b0 legacy=0x7f801406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8010a00640 1 -- 172.21.15.146:0/2074452378 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134118360 0 0) 0x7f801415b030 con 0x7f80140ad7b0 2024-08-17T02:27:03.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011400640 1 -- 172.21.15.146:0/2074452378 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140b1110 con 0x7f8014156d60 2024-08-17T02:27:03.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.225+0000 7f8011e00640 1 --2- 172.21.15.146:0/2074452378 >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 0x7f80140b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:03.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.226+0000 7f8011400640 1 --2- 172.21.15.146:0/2074452378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f80140b0ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80140635c0 tx=0x7f80000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad159870154a53e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8010a00640 1 -- 172.21.15.146:0/2074452378 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800002adb0 con 0x7f8014156d60 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8010a00640 1 -- 172.21.15.146:0/2074452378 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000032440 con 0x7f8014156d60 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8010a00640 1 -- 172.21.15.146:0/2074452378 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000327e0 con 0x7f8014156d60 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 -- 172.21.15.146:0/2074452378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 msgr2=0x7f80140b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 --2- 172.21.15.146:0/2074452378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f80140b0ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f80140635c0 tx=0x7f80000090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 -- 172.21.15.146:0/2074452378 shutdown_connections 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 --2- 172.21.15.146:0/2074452378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f80140b0ae0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 --2- 172.21.15.146:0/2074452378 >> v2:172.21.15.150:3300/0 conn(0x7f8014156990 0x7f80140b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 -- 172.21.15.146:0/2074452378 >> 172.21.15.146:0/2074452378 conn(0x7f8014067750 msgr2=0x7f80140cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 -- 172.21.15.146:0/2074452378 shutdown_connections 2024-08-17T02:27:03.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.227+0000 7f8019000640 1 -- 172.21.15.146:0/2074452378 wait complete. 2024-08-17T02:27:03.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.229+0000 7f8019000640 1 Processor -- start 2024-08-17T02:27:03.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.229+0000 7f8019000640 1 -- start start 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140ad7b0 0x7f8014069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 0x7f801414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c80b0 con 0x7f8014156d60 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8014158cf0 con 0x7f8014156990 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8019000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8014157db0 con 0x7f80140ad7b0 2024-08-17T02:27:03.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39848/0 (socket says 172.21.15.146:39848) 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 -- 172.21.15.146:0/4178428113 learned_addr learned my addr 172.21.15.146:0/4178428113 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8011400640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 0x7f801414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8011e00640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140ad7b0 0x7f8014069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 -- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140ad7b0 msgr2=0x7f8014069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140ad7b0 0x7f8014069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 -- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 msgr2=0x7f801414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 0x7f801414f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8012800640 1 -- 172.21.15.146:0/4178428113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009390 con 0x7f8014156d60 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.230+0000 7f8011400640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 0x7f801414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8012800640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f800c00cbf0 tx=0x7f800c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00ce10 con 0x7f8014156d60 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00a850 con 0x7f8014156d60 2024-08-17T02:27:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00ac90 con 0x7f8014156d60 2024-08-17T02:27:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8014158090 con 0x7f8014156d60 2024-08-17T02:27:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.231+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8014158980 con 0x7f8014156d60 2024-08-17T02:27:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.232+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8014158e80 con 0x7f8014156d60 2024-08-17T02:27:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.233+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f800c007300 con 0x7f8014156d60 2024-08-17T02:27:03.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.234+0000 7f8009600640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:03.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.234+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f800c082530 con 0x7f8014156d60 2024-08-17T02:27:03.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.234+0000 7f8011e00640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.235+0000 7f8011e00640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 0x7f7ff4067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f800400ab30 tx=0x7f8004008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:03.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.238+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f800c050670 con 0x7f8014156d60 2024-08-17T02:27:03.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:03.436+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001039307", "target": ["mon-mgr", ""]}) v1 -- 0x7f8014071050 con 0x7f7ff4065150 2024-08-17T02:27:06.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.340+0000 7f8009600640 1 -- 172.21.15.146:0/4178428113 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f8014071050 con 0x7f7ff4065150 2024-08-17T02:27:06.340 INFO:teuthology.orchestra.run.smithi146.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 msgr2=0x7f7ff4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 0x7f7ff4067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f800400ab30 tx=0x7f8004008040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 msgr2=0x7f801414f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f800c00cbf0 tx=0x7f800c0019b0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 shutdown_connections 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014156d60 0x7f801414f7d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8014156990 0x7f801414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 --2- 172.21.15.146:0/4178428113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80140ad7b0 0x7f8014069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 >> 172.21.15.146:0/4178428113 conn(0x7f8014067750 msgr2=0x7f801406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 shutdown_connections 2024-08-17T02:27:06.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.343+0000 7f8019000640 1 -- 172.21.15.146:0/4178428113 wait complete. 2024-08-17T02:27:06.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.532+0000 7f1282200640 1 Processor -- start 2024-08-17T02:27:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.532+0000 7f1282200640 1 -- start start 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f1282200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f1282200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0caa80 con 0x7f127c1401b0 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f1282200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0c9e70 con 0x7f127c140580 2024-08-17T02:27:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f1282200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0cb450 con 0x7f127c0b1440 2024-08-17T02:27:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f127b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f127c1401b0 0x7f127c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45772/0 (socket says 172.21.15.146:45772) 2024-08-17T02:27:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.533+0000 7f127b400640 1 -- 172.21.15.146:0/453919279 learned_addr learned my addr 172.21.15.146:0/453919279 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127aa00640 1 --2- 172.21.15.146:0/453919279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576736180 0 0) 0x7f127c0caa80 con 0x7f127c1401b0 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12600034e0 con 0x7f127c1401b0 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425335193 0 0) 0x7f127c0c9e70 con 0x7f127c140580 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127aa00640 1 -- 172.21.15.146:0/453919279 >> v1:172.21.15.150:6789/0 conn(0x7f127c140580 legacy=0x7f127c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127aa00640 1 -- 172.21.15.146:0/453919279 >> v1:172.21.15.146:6789/0 conn(0x7f127c1401b0 legacy=0x7f127c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.534+0000 7f127aa00640 1 -- 172.21.15.146:0/453919279 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0ca150 con 0x7f127c0b1440 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.535+0000 7f127aa00640 1 --2- 172.21.15.146:0/453919279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c0caf10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1268009880 tx=0x7f12680090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eaab01475732d99 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.535+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c001470 con 0x7f127c0b1440 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.535+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126802aab0 con 0x7f127c0b1440 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.535+0000 7f127a000640 1 -- 172.21.15.146:0/453919279 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126802ae50 con 0x7f127c0b1440 2024-08-17T02:27:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 -- 172.21.15.146:0/453919279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 msgr2=0x7f127c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 --2- 172.21.15.146:0/453919279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c0caf10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1268009880 tx=0x7f12680090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 -- 172.21.15.146:0/453919279 shutdown_connections 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 --2- 172.21.15.146:0/453919279 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c0caf10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 -- 172.21.15.146:0/453919279 >> 172.21.15.146:0/453919279 conn(0x7f127c0cb9b0 msgr2=0x7f127c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 -- 172.21.15.146:0/453919279 shutdown_connections 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.536+0000 7f1282200640 1 -- 172.21.15.146:0/453919279 wait complete. 2024-08-17T02:27:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.538+0000 7f1282200640 1 Processor -- start 2024-08-17T02:27:06.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.538+0000 7f1282200640 1 -- start start 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1401b0 0x7f127c0c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c1ab0 con 0x7f127c140580 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c1d90 con 0x7f127c1401b0 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f1282200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c2070 con 0x7f127c0b1440 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56060/0 (socket says 172.21.15.146:56060) 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 -- 172.21.15.146:0/1177082036 learned_addr learned my addr 172.21.15.146:0/1177082036 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127b400640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127aa00640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1401b0 0x7f127c0c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 -- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 msgr2=0x7f127c13ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c13ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 -- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1401b0 msgr2=0x7f127c0c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1401b0 0x7f127c0c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.539+0000 7f127be00640 1 -- 172.21.15.146:0/1177082036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009390 con 0x7f127c140580 2024-08-17T02:27:06.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f127be00640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1274001560 tx=0x7f12740016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400a7f0 con 0x7f127c140580 2024-08-17T02:27:06.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400a950 con 0x7f127c140580 2024-08-17T02:27:06.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0c2350 con 0x7f127c140580 2024-08-17T02:27:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400ad10 con 0x7f127c140580 2024-08-17T02:27:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.540+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c13f4b0 con 0x7f127c140580 2024-08-17T02:27:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.541+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c064db0 con 0x7f127c140580 2024-08-17T02:27:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.542+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1274003030 con 0x7f127c140580 2024-08-17T02:27:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.543+0000 7f1272a00640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 0x7f125c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.543+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1274082780 con 0x7f127c140580 2024-08-17T02:27:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.543+0000 7f127b400640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 0x7f125c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.544+0000 7f127b400640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 0x7f125c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f127c0b0640 tx=0x7f126c000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.548+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f12740504d0 con 0x7f127c140580 2024-08-17T02:27:06.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.741+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c0c8960 con 0x7f125c065150 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.743+0000 7f1272a00640 1 -- 172.21.15.146:0/1177082036 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f127c0c8960 con 0x7f125c065150 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: "name": "cephfs" 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: "name": "volume_0000000001039307" 2024-08-17T02:27:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-08-17T02:27:06.744 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-08-17T02:27:06.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 msgr2=0x7f125c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 0x7f125c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f127c0b0640 tx=0x7f126c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 msgr2=0x7f127c0c3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1274001560 tx=0x7f12740016c0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 shutdown_connections 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f125c065150 0x7f125c067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f127c140580 0x7f127c0c3a20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1401b0 0x7f127c0c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 --2- 172.21.15.146:0/1177082036 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c0b1440 0x7f127c13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 >> 172.21.15.146:0/1177082036 conn(0x7f127c0cb9b0 msgr2=0x7f127c06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 shutdown_connections 2024-08-17T02:27:06.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.745+0000 7f1282200640 1 -- 172.21.15.146:0/1177082036 wait complete. 2024-08-17T02:27:06.760 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:27:06.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.911+0000 7f2d99400640 1 Processor -- start 2024-08-17T02:27:06.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.911+0000 7f2d99400640 1 -- start start 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d99400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d940a54d0 0x7f2d94155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d99400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d94158400 con 0x7f2d94155980 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d99400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d941577f0 con 0x7f2d940af580 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d99400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d94157ad0 con 0x7f2d940a54d0 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d92800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d94155980 0x7f2d94156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45782/0 (socket says 172.21.15.146:45782) 2024-08-17T02:27:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.912+0000 7f2d92800640 1 -- 172.21.15.146:0/3408780862 learned_addr learned my addr 172.21.15.146:0/3408780862 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91e00640 1 --2- 172.21.15.146:0/3408780862 >> v2:172.21.15.150:3300/0 conn(0x7f2d940a54d0 0x7f2d94155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827652604 0 0) 0x7f2d94158400 con 0x7f2d94155980 2024-08-17T02:27:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d780034e0 con 0x7f2d94155980 2024-08-17T02:27:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91e00640 1 -- 172.21.15.146:0/3408780862 >> v1:172.21.15.150:6789/0 conn(0x7f2d940af580 legacy=0x7f2d94158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 551725334 0 0) 0x7f2d780034e0 con 0x7f2d94155980 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91e00640 1 -- 172.21.15.146:0/3408780862 >> v1:172.21.15.146:6789/0 conn(0x7f2d94155980 legacy=0x7f2d94156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.913+0000 7f2d91e00640 1 -- 172.21.15.146:0/3408780862 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94157db0 con 0x7f2d940a54d0 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.914+0000 7f2d91e00640 1 --2- 172.21.15.146:0/3408780862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94155d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009850 tx=0x7f2d800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e94d2c0ff033ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84001470 con 0x7f2d940a54d0 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8002ab00 con 0x7f2d940a54d0 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d91400640 1 -- 172.21.15.146:0/3408780862 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8002aea0 con 0x7f2d940a54d0 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 -- 172.21.15.146:0/3408780862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 msgr2=0x7f2d94155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 --2- 172.21.15.146:0/3408780862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94155d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009850 tx=0x7f2d800090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 -- 172.21.15.146:0/3408780862 shutdown_connections 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 --2- 172.21.15.146:0/3408780862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94155d50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 -- 172.21.15.146:0/3408780862 >> 172.21.15.146:0/3408780862 conn(0x7f2d94067750 msgr2=0x7f2d940cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 -- 172.21.15.146:0/3408780862 shutdown_connections 2024-08-17T02:27:06.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.915+0000 7f2d99400640 1 -- 172.21.15.146:0/3408780862 wait complete. 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.917+0000 7f2d99400640 1 Processor -- start 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.917+0000 7f2d99400640 1 -- start start 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d940af580 0x7f2d94148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d94145520 con 0x7f2d94155980 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9414a430 con 0x7f2d940a54d0 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d99400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d941693f0 con 0x7f2d940af580 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56074/0 (socket says 172.21.15.146:56074) 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 -- 172.21.15.146:0/1028495463 learned_addr learned my addr 172.21.15.146:0/1028495463 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d91e00640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d940af580 0x7f2d94148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d92800640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 -- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d940af580 msgr2=0x7f2d94148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d940af580 0x7f2d94148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 -- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 msgr2=0x7f2d94148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.918+0000 7f2d93200640 1 -- 172.21.15.146:0/1028495463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009390 con 0x7f2d94155980 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d93200640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c860 tx=0x7f2d8c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00a640 con 0x7f2d94155980 2024-08-17T02:27:06.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c00a7a0 con 0x7f2d94155980 2024-08-17T02:27:06.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d941495f0 con 0x7f2d94155980 2024-08-17T02:27:06.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c00ab60 con 0x7f2d94155980 2024-08-17T02:27:06.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.919+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9414a0c0 con 0x7f2d94155980 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.920+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d94149f20 con 0x7f2d94155980 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.921+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2d8c012420 con 0x7f2d94155980 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.922+0000 7f2d8a000640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 0x7f2d74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.922+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2d8c0829f0 con 0x7f2d94155980 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.922+0000 7f2d92800640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 0x7f2d74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.923+0000 7f2d92800640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 0x7f2d74067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d840011e0 tx=0x7f2d84000bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:06.926+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2d94149f20 con 0x7f2d94155980 2024-08-17T02:27:07.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.096+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f2d94149f20 con 0x7f2d94155980 2024-08-17T02:27:07.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.097+0000 7f2d8a000640 1 -- 172.21.15.146:0/1028495463 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8037 (secure 0 0 0) 0x7f2d94149f20 con 0x7f2d94155980 2024-08-17T02:27:07.097 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:27:07.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 msgr2=0x7f2d74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 0x7f2d74067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d840011e0 tx=0x7f2d84000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 msgr2=0x7f2d94144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00c860 tx=0x7f2d8c001690 comp rx=0 tx=0).stop 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 shutdown_connections 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2d74065150 0x7f2d74067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d94155980 0x7f2d94144210 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d940af580 0x7f2d94148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 --2- 172.21.15.146:0/1028495463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d940a54d0 0x7f2d94148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 >> 172.21.15.146:0/1028495463 conn(0x7f2d94067750 msgr2=0x7f2d9406e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 shutdown_connections 2024-08-17T02:27:07.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.099+0000 7f2d99400640 1 -- 172.21.15.146:0/1028495463 wait complete. 2024-08-17T02:27:07.115 INFO:teuthology.orchestra.run.smithi146.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}] 2024-08-17T02:27:07.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000001039307 --format=json 2024-08-17T02:27:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.266+0000 7f6aee400640 1 Processor -- start 2024-08-17T02:27:07.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.266+0000 7f6aee400640 1 -- start start 2024-08-17T02:27:07.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ae80cc010 0x7f6ae80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80a98e0 0x7f6ae80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ae80b03d0 0x7f6ae815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80ab950 con 0x7f6ae80b03d0 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80abc30 con 0x7f6ae80cc010 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aee400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80abf10 con 0x7f6ae80a98e0 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aeda00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ae80b03d0 0x7f6ae815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aeda00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ae80b03d0 0x7f6ae815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56082/0 (socket says 172.21.15.146:56082) 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aeda00640 1 -- 172.21.15.146:0/960996797 learned_addr learned my addr 172.21.15.146:0/960996797 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6aed000640 1 --2- 172.21.15.146:0/960996797 >> v2:172.21.15.150:3300/0 conn(0x7f6ae80cc010 0x7f6ae80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.267+0000 7f6adfe00640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80a98e0 0x7f6ae80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.268+0000 7f6aeda00640 1 -- 172.21.15.146:0/960996797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80a98e0 msgr2=0x7f6ae80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.268+0000 7f6aeda00640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80a98e0 0x7f6ae80afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.268+0000 7f6aeda00640 1 -- 172.21.15.146:0/960996797 >> v2:172.21.15.150:3300/0 conn(0x7f6ae80cc010 msgr2=0x7f6ae80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.268+0000 7f6aeda00640 1 --2- 172.21.15.146:0/960996797 >> v2:172.21.15.150:3300/0 conn(0x7f6ae80cc010 0x7f6ae80ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.268+0000 7f6aeda00640 1 -- 172.21.15.146:0/960996797 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80af970 con 0x7f6ae80b03d0 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.269+0000 7f6aeda00640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae815c7c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8064c30 tx=0x7f6ae0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31450d4e93c5ba07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.269+0000 7f6ae7e00640 1 -- 172.21.15.146:0/960996797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0031400 con 0x7f6ae80b03d0 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.269+0000 7f6ae7e00640 1 -- 172.21.15.146:0/960996797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae002d050 con 0x7f6ae80b03d0 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.269+0000 7f6ae7e00640 1 -- 172.21.15.146:0/960996797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00317d0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 -- 172.21.15.146:0/960996797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 msgr2=0x7f6ae815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae815c7c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8064c30 tx=0x7f6ae0009840 comp rx=0 tx=0).stop 2024-08-17T02:27:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 -- 172.21.15.146:0/960996797 shutdown_connections 2024-08-17T02:27:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae815c7c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 --2- 172.21.15.146:0/960996797 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80a98e0 0x7f6ae80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 --2- 172.21.15.146:0/960996797 >> v2:172.21.15.150:3300/0 conn(0x7f6ae80cc010 0x7f6ae80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 -- 172.21.15.146:0/960996797 >> 172.21.15.146:0/960996797 conn(0x7f6ae8067de0 msgr2=0x7f6ae80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 -- 172.21.15.146:0/960996797 shutdown_connections 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.270+0000 7f6aee400640 1 -- 172.21.15.146:0/960996797 wait complete. 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.271+0000 7f6aee400640 1 Processor -- start 2024-08-17T02:27:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.271+0000 7f6aee400640 1 -- start start 2024-08-17T02:27:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae80a98e0 0x7f6ae8066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80cc010 0x7f6ae8145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80c2910 con 0x7f6ae80b03d0 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8169fa0 con 0x7f6ae80a98e0 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aee400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80c36d0 con 0x7f6ae80cc010 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6adfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6adfe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56096/0 (socket says 172.21.15.146:56096) 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6adfe00640 1 -- 172.21.15.146:0/1342460837 learned_addr learned my addr 172.21.15.146:0/1342460837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aeda00640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80cc010 0x7f6ae8145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.272+0000 7f6aed000640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae80a98e0 0x7f6ae8066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 -- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80cc010 msgr2=0x7f6ae8145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80cc010 0x7f6ae8145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 -- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae80a98e0 msgr2=0x7f6ae8066f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae80a98e0 0x7f6ae8066f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 -- 172.21.15.146:0/1342460837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009ae0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6adfe00640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000e900 tx=0x7f6ad00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000c8e0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000ca40 con 0x7f6ae80b03d0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000cde0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8169cc0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.273+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae80c3360 con 0x7f6ae80b03d0 2024-08-17T02:27:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.275+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80c3840 con 0x7f6ae80b03d0 2024-08-17T02:27:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.275+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ad0013680 con 0x7f6ae80b03d0 2024-08-17T02:27:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.276+0000 7f6ae4c00640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 0x7f6ac4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.276+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6ad00829b0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.276+0000 7f6aed000640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 0x7f6ac4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.277+0000 7f6aed000640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 0x7f6ac4067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009d20 tx=0x7f6ad80090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.280+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6ad00507c0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.492+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000001039307", "format": "json"} v 0) v1 -- 0x7f6ae8071050 con 0x7f6ae80b03d0 2024-08-17T02:27:07.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.493+0000 7f6ae4c00640 1 -- 172.21.15.146:0/1342460837 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000001039307", "format": "json"}]=0 v21) v1 ==== 110+0+1844 (secure 0 0 0) 0x7f6ad0053de0 con 0x7f6ae80b03d0 2024-08-17T02:27:07.493 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:27:07.493 INFO:teuthology.orchestra.run.smithi146.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.494+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 msgr2=0x7f6ac4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.494+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 0x7f6ac4067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009d20 tx=0x7f6ad80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.494+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 msgr2=0x7f6ae8145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.494+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000e900 tx=0x7f6ad00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 shutdown_connections 2024-08-17T02:27:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6ac4065150 0x7f6ac4067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae80b03d0 0x7f6ae8145a90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ae80cc010 0x7f6ae8145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 --2- 172.21.15.146:0/1342460837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ae80a98e0 0x7f6ae8066f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 >> 172.21.15.146:0/1342460837 conn(0x7f6ae8067de0 msgr2=0x7f6ae806ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 shutdown_connections 2024-08-17T02:27:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.495+0000 7f6aee400640 1 -- 172.21.15.146:0/1342460837 wait complete. 2024-08-17T02:27:07.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039307 --yes-i-really-mean-it 2024-08-17T02:27:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.661+0000 7f4d47e00640 1 Processor -- start 2024-08-17T02:27:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.661+0000 7f4d47e00640 1 -- start start 2024-08-17T02:27:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d47e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d4815ce70 0x7f4d4806d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d47e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4806d720 con 0x7f4d480cb9f0 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d47e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4806da00 con 0x7f4d48066cd0 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d47e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d481536c0 con 0x7f4d4815ce70 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d46a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d480cb9f0 0x7f4d480abde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45792/0 (socket says 172.21.15.146:45792) 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d46a00640 1 -- 172.21.15.146:0/1969333715 learned_addr learned my addr 172.21.15.146:0/1969333715 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.662+0000 7f4d47400640 1 --2- 172.21.15.146:0/1969333715 >> v2:172.21.15.146:3300/0 conn(0x7f4d4815ce70 0x7f4d4806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.663+0000 7f4d47400640 1 -- 172.21.15.146:0/1969333715 >> v1:172.21.15.150:6789/0 conn(0x7f4d48066cd0 legacy=0x7f4d4815c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.663+0000 7f4d47400640 1 -- 172.21.15.146:0/1969333715 >> v1:172.21.15.146:6789/0 conn(0x7f4d480cb9f0 legacy=0x7f4d480abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.663+0000 7f4d47400640 1 -- 172.21.15.146:0/1969333715 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4806dce0 con 0x7f4d4815ce70 2024-08-17T02:27:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.664+0000 7f4d47400640 1 --2- 172.21.15.146:0/1969333715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4815ce70 0x7f4d4806d020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009e60 tx=0x7f4d40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1123d7cf4bcbe3b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.664+0000 7f4d45600640 1 -- 172.21.15.146:0/1969333715 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40007550 con 0x7f4d4815ce70 2024-08-17T02:27:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.664+0000 7f4d45600640 1 -- 172.21.15.146:0/1969333715 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4002d050 con 0x7f4d4815ce70 2024-08-17T02:27:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.664+0000 7f4d45600640 1 -- 172.21.15.146:0/1969333715 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40007920 con 0x7f4d4815ce70 2024-08-17T02:27:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 -- 172.21.15.146:0/1969333715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4815ce70 msgr2=0x7f4d4806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 --2- 172.21.15.146:0/1969333715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4815ce70 0x7f4d4806d020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009e60 tx=0x7f4d40009780 comp rx=0 tx=0).stop 2024-08-17T02:27:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 -- 172.21.15.146:0/1969333715 shutdown_connections 2024-08-17T02:27:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 --2- 172.21.15.146:0/1969333715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4815ce70 0x7f4d4806d020 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 -- 172.21.15.146:0/1969333715 >> 172.21.15.146:0/1969333715 conn(0x7f4d480cca90 msgr2=0x7f4d480a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 -- 172.21.15.146:0/1969333715 shutdown_connections 2024-08-17T02:27:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.665+0000 7f4d47e00640 1 -- 172.21.15.146:0/1969333715 wait complete. 2024-08-17T02:27:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.666+0000 7f4d47e00640 1 Processor -- start 2024-08-17T02:27:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.666+0000 7f4d47e00640 1 -- start start 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48066cd0 0x7f4d48150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d480cb9f0 0x7f4d481506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4815ce70 0x7f4d481695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d48155540 con 0x7f4d48066cd0 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b1400 con 0x7f4d4815ce70 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d47e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b16e0 con 0x7f4d480cb9f0 2024-08-17T02:27:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.667+0000 7f4d46a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48066cd0 0x7f4d48150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48066cd0 0x7f4d48150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56126/0 (socket says 172.21.15.146:56126) 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 -- 172.21.15.146:0/3599319000 learned_addr learned my addr 172.21.15.146:0/3599319000 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d47400640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4815ce70 0x7f4d481695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46000640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d480cb9f0 0x7f4d481506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 -- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d480cb9f0 msgr2=0x7f4d481506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d480cb9f0 0x7f4d481506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 -- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4815ce70 msgr2=0x7f4d481695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d4815ce70 0x7f4d481695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 -- 172.21.15.146:0/3599319000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009a20 con 0x7f4d48066cd0 2024-08-17T02:27:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d46a00640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d48066cd0 0x7f4d48150190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c590 tx=0x7f4d38007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38005aa0 con 0x7f4d48066cd0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38005c20 con 0x7f4d48066cd0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d47e00640 1 -- 172.21.15.146:0/3599319000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d480b19c0 con 0x7f4d48066cd0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.668+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380070f0 con 0x7f4d48066cd0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.669+0000 7f4d47e00640 1 -- 172.21.15.146:0/3599319000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d48169020 con 0x7f4d48066cd0 2024-08-17T02:27:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.670+0000 7f4d47e00640 1 -- 172.21.15.146:0/3599319000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d481692a0 con 0x7f4d48066cd0 2024-08-17T02:27:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.670+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4d38007540 con 0x7f4d48066cd0 2024-08-17T02:27:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.671+0000 7f4d3e000640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4d28065150 0x7f4d28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.671+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4d38081b90 con 0x7f4d48066cd0 2024-08-17T02:27:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.671+0000 7f4d46000640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4d28065150 0x7f4d28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.672+0000 7f4d46000640 1 --2- 172.21.15.146:0/3599319000 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4d28065150 0x7f4d28067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d4815b580 tx=0x7f4d34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.675+0000 7f4d3e000640 1 -- 172.21.15.146:0/3599319000 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d3804f950 con 0x7f4d48066cd0 2024-08-17T02:27:07.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:27:07.872+0000 7f4d47e00640 1 -- 172.21.15.146:0/3599319000 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001039307", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d48071050 con 0x7f4d28065150 2024-08-17T02:27:12.232 INFO:tasks.ceph.mds.b.smithi150.stderr:2024-08-17T02:27:12.231+0000 7fd7bb200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:29.342 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:29.348 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:59.467 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:59.473 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:29.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:29.570 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:59.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:59.672 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:07.579 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:29:07.580 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:29:07.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:07.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:07.757 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:29:07.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:29:07.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:07.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:07.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:29:07.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:07.826 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:29:07.862 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:29:07.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:07.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:07.926 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:29:07.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:07.926 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:29:07.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.112+0000 7f8ff9400640 1 Processor -- start 2024-08-17T02:29:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.112+0000 7f8ff9400640 1 -- start start 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff9400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ff40cf2d0 0x7f8ff40ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff9400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ff40ad6e0 0x7f8ff40adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff9400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff40cb730 con 0x7f8ff40ca350 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff9400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff40cae30 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff9400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff40cf9c0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff8a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ff40ad6e0 0x7f8ff40adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff8a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ff40ad6e0 0x7f8ff40adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36442/0 (socket says 172.21.15.146:36442) 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff8a00640 1 -- 172.21.15.146:0/1425755467 learned_addr learned my addr 172.21.15.146:0/1425755467 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.113+0000 7f8ff3400640 1 --2- 172.21.15.146:0/1425755467 >> v2:172.21.15.150:3300/0 conn(0x7f8ff40cf2d0 0x7f8ff40ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.114+0000 7f8ff8a00640 1 -- 172.21.15.146:0/1425755467 >> v2:172.21.15.150:3300/0 conn(0x7f8ff40cf2d0 msgr2=0x7f8ff40ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.114+0000 7f8ff8a00640 1 --2- 172.21.15.146:0/1425755467 >> v2:172.21.15.150:3300/0 conn(0x7f8ff40cf2d0 0x7f8ff40ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.114+0000 7f8ff8a00640 1 -- 172.21.15.146:0/1425755467 >> v1:172.21.15.150:6789/0 conn(0x7f8ff40ca350 legacy=0x7f8ff40ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.114+0000 7f8ff8a00640 1 -- 172.21.15.146:0/1425755467 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40cb0e0 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.115+0000 7f8ff8a00640 1 --2- 172.21.15.146:0/1425755467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40ad6e0 0x7f8ff40adb40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40cfd80 tx=0x7f8fec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60033028e2924fef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.115+0000 7f8ff2a00640 1 -- 172.21.15.146:0/1425755467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec032480 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.115+0000 7f8ff2a00640 1 -- 172.21.15.146:0/1425755467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0325e0 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.115+0000 7f8ff2a00640 1 -- 172.21.15.146:0/1425755467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0329c0 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 -- 172.21.15.146:0/1425755467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40ad6e0 msgr2=0x7f8ff40adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 --2- 172.21.15.146:0/1425755467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40ad6e0 0x7f8ff40adb40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40cfd80 tx=0x7f8fec009840 comp rx=0 tx=0).stop 2024-08-17T02:29:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 -- 172.21.15.146:0/1425755467 shutdown_connections 2024-08-17T02:29:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 --2- 172.21.15.146:0/1425755467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40ad6e0 0x7f8ff40adb40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 --2- 172.21.15.146:0/1425755467 >> v2:172.21.15.150:3300/0 conn(0x7f8ff40cf2d0 0x7f8ff40ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 -- 172.21.15.146:0/1425755467 >> 172.21.15.146:0/1425755467 conn(0x7f8ff40cfdb0 msgr2=0x7f8ff40d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 -- 172.21.15.146:0/1425755467 shutdown_connections 2024-08-17T02:29:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.116+0000 7f8ff9400640 1 -- 172.21.15.146:0/1425755467 wait complete. 2024-08-17T02:29:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.117+0000 7f8ff9400640 1 Processor -- start 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.117+0000 7f8ff9400640 1 -- start start 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 0x7f8ff4169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ff40ca350 0x7f8ff4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4169e60 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c69d0 con 0x7f8ff40ca350 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff9400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff40c9260 con 0x7f8ff40ad6e0 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff8a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36456/0 (socket says 172.21.15.146:36456) 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff8a00640 1 -- 172.21.15.146:0/3607311325 learned_addr learned my addr 172.21.15.146:0/3607311325 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff3400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ff40ca350 0x7f8ff4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.118+0000 7f8ff3e00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 0x7f8ff4169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 -- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 msgr2=0x7f8ff4169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 0x7f8ff4169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 -- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ff40ca350 msgr2=0x7f8ff4158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ff40ca350 0x7f8ff4158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 -- 172.21.15.146:0/3607311325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec009ae0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff3e00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 0x7f8ff4169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff8a00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009f50 tx=0x7f8fec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec008ad0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec008c50 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff41587d0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec03c410 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.119+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff40c97e0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.121+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff4071050 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.121+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8fec003020 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.122+0000 7f8feb400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 0x7f8fd4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.122+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8fec0a3660 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.122+0000 7f8ff3e00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 0x7f8fd4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.123+0000 7f8ff3e00640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 0x7f8fd4067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001820 tx=0x7f8fe4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.127+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8fec071460 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.337+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ff4062fa0 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.338+0000 7f8feb400640 1 -- 172.21.15.146:0/3607311325 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f8fec074a80 con 0x7f8ff40cf2d0 2024-08-17T02:29:08.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:08.338 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:08.339 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-08-17T02:29:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 msgr2=0x7f8fd4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 0x7f8fd4067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4001820 tx=0x7f8fe4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 msgr2=0x7f8ff409b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009f50 tx=0x7f8fec037000 comp rx=0 tx=0).stop 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 shutdown_connections 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8fd4065180 0x7f8fd4067630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ff40cf2d0 0x7f8ff409b110 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ff40ca350 0x7f8ff4158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 --2- 172.21.15.146:0/3607311325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ff40ad6e0 0x7f8ff4169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 >> 172.21.15.146:0/3607311325 conn(0x7f8ff40cfdb0 msgr2=0x7f8ff40adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 shutdown_connections 2024-08-17T02:29:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.340+0000 7f8ff9400640 1 -- 172.21.15.146:0/3607311325 wait complete. 2024-08-17T02:29:08.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.506+0000 7f16acc00640 1 Processor -- start 2024-08-17T02:29:08.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.506+0000 7f16acc00640 1 -- start start 2024-08-17T02:29:08.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.507+0000 7f16acc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80ad070 0x7f16a80aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.507+0000 7f16acc00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f16a80a98e0 0x7f16a80ab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.507+0000 7f16acc00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80aaa40 con 0x7f16a8158b10 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.507+0000 7f16acc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80a9e30 con 0x7f16a80ad070 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.507+0000 7f16acc00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80aa110 con 0x7f16a80a98e0 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80ad070 0x7f16a80aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16a80ad070 0x7f16a80aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36470/0 (socket says 172.21.15.146:36470) 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 -- 172.21.15.146:0/1086643071 learned_addr learned my addr 172.21.15.146:0/1086643071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a6800640 1 --2- 172.21.15.146:0/1086643071 >> v2:172.21.15.150:3300/0 conn(0x7f16a80a98e0 0x7f16a80ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 -- 172.21.15.146:0/1086643071 >> v2:172.21.15.150:3300/0 conn(0x7f16a80a98e0 msgr2=0x7f16a80ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 --2- 172.21.15.146:0/1086643071 >> v2:172.21.15.150:3300/0 conn(0x7f16a80a98e0 0x7f16a80ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 -- 172.21.15.146:0/1086643071 >> v1:172.21.15.150:6789/0 conn(0x7f16a8158b10 legacy=0x7f16a80c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.508+0000 7f16a5400640 1 -- 172.21.15.146:0/1086643071 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80aa3f0 con 0x7f16a80ad070 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.509+0000 7f16a5400640 1 --2- 172.21.15.146:0/1086643071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80aaed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f16a8064720 tx=0x7f16940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9d69279c503d98 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.509+0000 7f16a4a00640 1 -- 172.21.15.146:0/1086643071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169402add0 con 0x7f16a80ad070 2024-08-17T02:29:08.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.509+0000 7f16a4a00640 1 -- 172.21.15.146:0/1086643071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694032440 con 0x7f16a80ad070 2024-08-17T02:29:08.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.509+0000 7f16a4a00640 1 -- 172.21.15.146:0/1086643071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694032820 con 0x7f16a80ad070 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 -- 172.21.15.146:0/1086643071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 msgr2=0x7f16a80aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 --2- 172.21.15.146:0/1086643071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80aaed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f16a8064720 tx=0x7f16940091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 -- 172.21.15.146:0/1086643071 shutdown_connections 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 --2- 172.21.15.146:0/1086643071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80aaed0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 --2- 172.21.15.146:0/1086643071 >> v2:172.21.15.150:3300/0 conn(0x7f16a80a98e0 0x7f16a80ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 -- 172.21.15.146:0/1086643071 >> 172.21.15.146:0/1086643071 conn(0x7f16a8066cd0 msgr2=0x7f16a80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 -- 172.21.15.146:0/1086643071 shutdown_connections 2024-08-17T02:29:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.510+0000 7f16acc00640 1 -- 172.21.15.146:0/1086643071 wait complete. 2024-08-17T02:29:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.512+0000 7f16acc00640 1 Processor -- start 2024-08-17T02:29:08.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.512+0000 7f16acc00640 1 -- start start 2024-08-17T02:29:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.512+0000 7f16acc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80a98e0 0x7f16a80c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.512+0000 7f16acc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16acc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 0x7f16a81463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16acc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80c0e40 con 0x7f16a80ad070 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16acc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a815b490 con 0x7f16a8158b10 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16acc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a815b770 con 0x7f16a80a98e0 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36482/0 (socket says 172.21.15.146:36482) 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 -- 172.21.15.146:0/3092109171 learned_addr learned my addr 172.21.15.146:0/3092109171 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5e00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80a98e0 0x7f16a80c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a6800640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 0x7f16a81463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 -- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80a98e0 msgr2=0x7f16a80c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80a98e0 0x7f16a80c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 -- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 msgr2=0x7f16a81463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 0x7f16a81463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 -- 172.21.15.146:0/3092109171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009450 con 0x7f16a80ad070 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a6800640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 0x7f16a81463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.513+0000 7f16a5400640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1694009210 tx=0x7f1694032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.514+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694031c80 con 0x7f16a80ad070 2024-08-17T02:29:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.514+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694031e00 con 0x7f16a80ad070 2024-08-17T02:29:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.514+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169403d670 con 0x7f16a80ad070 2024-08-17T02:29:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.514+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a815ba50 con 0x7f16a80ad070 2024-08-17T02:29:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.514+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a80c34b0 con 0x7f16a80ad070 2024-08-17T02:29:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.515+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80c0fb0 con 0x7f16a80ad070 2024-08-17T02:29:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.516+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1694039040 con 0x7f16a80ad070 2024-08-17T02:29:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.517+0000 7f169d600640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.517+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f16940a2640 con 0x7f16a80ad070 2024-08-17T02:29:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.517+0000 7f16a5e00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.518+0000 7f16a5e00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 0x7f1688067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1698007fd0 tx=0x7f1698007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.521+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f16a80c0fb0 con 0x7f16a80ad070 2024-08-17T02:29:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.696+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a80c0f80 con 0x7f16a80ad070 2024-08-17T02:29:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.697+0000 7f169d600640 1 -- 172.21.15.146:0/3092109171 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f1694070390 con 0x7f16a80ad070 2024-08-17T02:29:08.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:08.698 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:27:07.369226+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 msgr2=0x7f1688067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 0x7f1688067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1698007fd0 tx=0x7f1698007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 msgr2=0x7f16a80b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1694009210 tx=0x7f1694032000 comp rx=0 tx=0).stop 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 shutdown_connections 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1688065150 0x7f1688067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a80ad070 0x7f16a80b0790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16a8158b10 0x7f16a81463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 --2- 172.21.15.146:0/3092109171 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16a80a98e0 0x7f16a80c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 >> 172.21.15.146:0/3092109171 conn(0x7f16a8066cd0 msgr2=0x7f16a80ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 shutdown_connections 2024-08-17T02:29:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.699+0000 7f16acc00640 1 -- 172.21.15.146:0/3092109171 wait complete. 2024-08-17T02:29:08.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:50.661597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:51.648827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001039307.meta', 'create_time': '2024-08-17T02:27:03.475416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001039307'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001039307.data', 'create_time': '2024-08-17T02:27:04.382680+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001039307'}}}] 2024-08-17T02:29:08.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.868+0000 7f7cdbe00640 1 Processor -- start 2024-08-17T02:29:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.868+0000 7f7cdbe00640 1 -- start start 2024-08-17T02:29:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdbe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdbe00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc159a60 con 0x7f7cdc154ce0 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdbe00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc158bb0 con 0x7f7cdc1550b0 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdbe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc158e50 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdb400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36496/0 (socket says 172.21.15.146:36496) 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdb400640 1 -- 172.21.15.146:0/3120948580 learned_addr learned my addr 172.21.15.146:0/3120948580 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.869+0000 7f7cdaa00640 1 --1- 172.21.15.146:0/3120948580 >> v1:172.21.15.146:6789/0 conn(0x7f7cdc154ce0 0x7f7cdc0c7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39484/0 (socket says 172.21.15.146:39484) 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.870+0000 7f7cdb400640 1 -- 172.21.15.146:0/3120948580 >> v1:172.21.15.150:6789/0 conn(0x7f7cdc1550b0 legacy=0x7f7cdc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.870+0000 7f7cdb400640 1 -- 172.21.15.146:0/3120948580 >> v1:172.21.15.146:6789/0 conn(0x7f7cdc154ce0 legacy=0x7f7cdc0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.870+0000 7f7cdb400640 1 -- 172.21.15.146:0/3120948580 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc159130 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.870+0000 7f7cda000640 1 -- 172.21.15.146:0/3120948580 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001011044 0 0) 0x7f7cdc159a60 con 0x7f7cdc154ce0 2024-08-17T02:29:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.871+0000 7f7cdb400640 1 --2- 172.21.15.146:0/3120948580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400d1a0 tx=0x7f7cd400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dcfa30b3e9e620 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.871+0000 7f7cda000640 1 -- 172.21.15.146:0/3120948580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400b2e0 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.871+0000 7f7cda000640 1 -- 172.21.15.146:0/3120948580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd400b440 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.871+0000 7f7cda000640 1 -- 172.21.15.146:0/3120948580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4009840 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 -- 172.21.15.146:0/3120948580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 msgr2=0x7f7cdc15ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/3120948580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400d1a0 tx=0x7f7cd400ba50 comp rx=0 tx=0).stop 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 -- 172.21.15.146:0/3120948580 shutdown_connections 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/3120948580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc15ff50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 -- 172.21.15.146:0/3120948580 >> 172.21.15.146:0/3120948580 conn(0x7f7cdc067750 msgr2=0x7f7cdc06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 -- 172.21.15.146:0/3120948580 shutdown_connections 2024-08-17T02:29:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.872+0000 7f7cdbe00640 1 -- 172.21.15.146:0/3120948580 wait complete. 2024-08-17T02:29:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.873+0000 7f7cdbe00640 1 Processor -- start 2024-08-17T02:29:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.873+0000 7f7cdbe00640 1 -- start start 2024-08-17T02:29:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc154ce0 0x7f7cdc16a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc1550b0 0x7f7cdc155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc13ff70 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc16c2e0 con 0x7f7cdc154ce0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdbe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc068af0 con 0x7f7cdc1550b0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdaa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36498/0 (socket says 172.21.15.146:36498) 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.874+0000 7f7cdaa00640 1 -- 172.21.15.146:0/2601875715 learned_addr learned my addr 172.21.15.146:0/2601875715 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdb400640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc1550b0 0x7f7cdc155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cd3e00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc154ce0 0x7f7cdc16a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 -- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc1550b0 msgr2=0x7f7cdc155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc1550b0 0x7f7cdc155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 -- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc154ce0 msgr2=0x7f7cdc16a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc154ce0 0x7f7cdc16a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 -- 172.21.15.146:0/2601875715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd400bcf0 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdaa00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c5e0 tx=0x7f7ccc007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc007300 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc007480 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0049f0 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc169e40 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.875+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0684a0 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.876+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc071050 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.877+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ccc0113a0 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.878+0000 7f7cd2000640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 0x7f7cb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.878+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7ccc081990 con 0x7f7cdc0b02f0 2024-08-17T02:29:08.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.878+0000 7f7cd3e00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 0x7f7cb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.879+0000 7f7cd3e00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 0x7f7cb8067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc14e470 tx=0x7f7cc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:08.882+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ccc04f6b0 con 0x7f7cdc0b02f0 2024-08-17T02:29:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.052+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cdc0ad170 con 0x7f7cdc0b02f0 2024-08-17T02:29:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.053+0000 7f7cd2000640 1 -- 172.21.15.146:0/2601875715 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ccc0180a0 con 0x7f7cdc0b02f0 2024-08-17T02:29:09.053 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:29:09.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 msgr2=0x7f7cb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 0x7f7cb8067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc14e470 tx=0x7f7cc4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:09.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 msgr2=0x7f7cdc13fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c5e0 tx=0x7f7ccc007d00 comp rx=0 tx=0).stop 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 shutdown_connections 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7cb8065150 0x7f7cb8067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cdc1550b0 0x7f7cdc155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cdc154ce0 0x7f7cdc16a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 --2- 172.21.15.146:0/2601875715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc0b02f0 0x7f7cdc13fa30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 >> 172.21.15.146:0/2601875715 conn(0x7f7cdc067750 msgr2=0x7f7cdc151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 shutdown_connections 2024-08-17T02:29:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.055+0000 7f7cdbe00640 1 -- 172.21.15.146:0/2601875715 wait complete. 2024-08-17T02:29:09.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.221+0000 7fa0fe000640 1 Processor -- start 2024-08-17T02:29:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.221+0000 7fa0fe000640 1 -- start start 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 0x7fa0f806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 0x7fa0f80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0f8155e50 0x7fa0f80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f81598f0 con 0x7fa0f8155e50 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8159bd0 con 0x7fa0f80c7db0 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.222+0000 7fa0fe000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8159eb0 con 0x7fa0f8155a80 2024-08-17T02:29:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0f8155e50 0x7fa0f80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0f8155e50 0x7fa0f80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36512/0 (socket says 172.21.15.146:36512) 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 -- 172.21.15.146:0/1896689175 learned_addr learned my addr 172.21.15.146:0/1896689175 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 0x7fa0f806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f6a00640 1 --2- 172.21.15.146:0/1896689175 >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 0x7fa0f80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 -- 172.21.15.146:0/1896689175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 msgr2=0x7fa0f806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 0x7fa0f806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 -- 172.21.15.146:0/1896689175 >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 msgr2=0x7fa0f80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 --2- 172.21.15.146:0/1896689175 >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 0x7fa0f80c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7e00640 1 -- 172.21.15.146:0/1896689175 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f815a190 con 0x7fa0f8155e50 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 0x7fa0f806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.223+0000 7fa0f6a00640 1 --2- 172.21.15.146:0/1896689175 >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 0x7fa0f80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.224+0000 7fa0f7e00640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155e50 0x7fa0f80c9110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8068570 tx=0x7fa0f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b037d885840e962 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.224+0000 7fa0f6000640 1 -- 172.21.15.146:0/1896689175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0031400 con 0x7fa0f8155e50 2024-08-17T02:29:09.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0f6000640 1 -- 172.21.15.146:0/1896689175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f002d050 con 0x7fa0f8155e50 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0f6000640 1 -- 172.21.15.146:0/1896689175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00317d0 con 0x7fa0f8155e50 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 -- 172.21.15.146:0/1896689175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155e50 msgr2=0x7fa0f80c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155e50 0x7fa0f80c9110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8068570 tx=0x7fa0f0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 -- 172.21.15.146:0/1896689175 shutdown_connections 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155e50 0x7fa0f80c9110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1896689175 >> v2:172.21.15.150:3300/0 conn(0x7fa0f80c7db0 0x7fa0f80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1896689175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f8155a80 0x7fa0f806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 -- 172.21.15.146:0/1896689175 >> 172.21.15.146:0/1896689175 conn(0x7fa0f8067750 msgr2=0x7fa0f80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 -- 172.21.15.146:0/1896689175 shutdown_connections 2024-08-17T02:29:09.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.225+0000 7fa0fe000640 1 -- 172.21.15.146:0/1896689175 wait complete. 2024-08-17T02:29:09.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.227+0000 7fa0fe000640 1 Processor -- start 2024-08-17T02:29:09.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.227+0000 7fa0fe000640 1 -- start start 2024-08-17T02:29:09.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.227+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 0x7fa0f8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.227+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0fe000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 0x7fa0f8165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0fe000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f814fc10 con 0x7fa0f8155a80 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0fe000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f814feb0 con 0x7fa0f8155e50 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0fe000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81548f0 con 0x7fa0f80c7db0 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36526/0 (socket says 172.21.15.146:36526) 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 -- 172.21.15.146:0/1815970013 learned_addr learned my addr 172.21.15.146:0/1815970013 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 0x7fa0f8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f7e00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 0x7fa0f8165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 -- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 msgr2=0x7fa0f8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 0x7fa0f8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 -- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 msgr2=0x7fa0f8165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 0x7fa0f8165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f6a00640 1 -- 172.21.15.146:0/1815970013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009ae0 con 0x7fa0f8155a80 2024-08-17T02:29:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 0x7fa0f8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.228+0000 7fa0f7e00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 0x7fa0f8165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:09.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0f6a00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400d890 tx=0x7fa0e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400de80 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e400b8d0 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400bc90 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f8154bd0 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.229+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f813ae20 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.230+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f806e440 con 0x7fa0f8155a80 2024-08-17T02:29:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.231+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa0e401e460 con 0x7fa0f8155a80 2024-08-17T02:29:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.232+0000 7fa0eea00640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 0x7fa0d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.232+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa0e4082f50 con 0x7fa0f8155a80 2024-08-17T02:29:09.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.232+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 0x7fa0d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.233+0000 7fa0f7400640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 0x7fa0d8067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8159750 tx=0x7fa0e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.236+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa0f806e440 con 0x7fa0f8155a80 2024-08-17T02:29:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.413+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0f806e440 con 0x7fa0f8155a80 2024-08-17T02:29:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.414+0000 7fa0eea00640 1 -- 172.21.15.146:0/1815970013 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0f806e440 con 0x7fa0f8155a80 2024-08-17T02:29:09.414 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:29:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 msgr2=0x7fa0d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 0x7fa0d8067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8159750 tx=0x7fa0e8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 msgr2=0x7fa0f8164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400d890 tx=0x7fa0e4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 shutdown_connections 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa0d8065150 0x7fa0d8067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0f8155a80 0x7fa0f8164f50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8155e50 0x7fa0f8165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 --2- 172.21.15.146:0/1815970013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f80c7db0 0x7fa0f8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 >> 172.21.15.146:0/1815970013 conn(0x7fa0f8067750 msgr2=0x7fa0f814f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 shutdown_connections 2024-08-17T02:29:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.416+0000 7fa0fe000640 1 -- 172.21.15.146:0/1815970013 wait complete. 2024-08-17T02:29:09.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:09.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.582+0000 7f3e95e00640 1 Processor -- start 2024-08-17T02:29:09.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.582+0000 7f3e95e00640 1 -- start start 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e900accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e900ad210 0x7f3e9006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e90156e60 con 0x7f3e9006d930 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e900c95e0 con 0x7f3e900ad210 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900ad660 con 0x7f3e900abef0 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e9006d930 0x7f3e9015a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39492/0 (socket says 172.21.15.146:39492) 2024-08-17T02:29:09.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e95400640 1 -- 172.21.15.146:0/4201134240 learned_addr learned my addr 172.21.15.146:0/4201134240 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e94a00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e900accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> v2:172.21.15.150:3300/0 conn(0x7f3e900ad210 0x7f3e9006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485618608 0 0) 0x7f3e90156e60 con 0x7f3e9006d930 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.584+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e740034e0 con 0x7f3e9006d930 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3867328900 0 0) 0x7f3e740034e0 con 0x7f3e9006d930 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 msgr2=0x7f3e900accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e900accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 >> v2:172.21.15.150:3300/0 conn(0x7f3e900ad210 msgr2=0x7f3e9006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 --2- 172.21.15.146:0/4201134240 >> v2:172.21.15.150:3300/0 conn(0x7f3e900ad210 0x7f3e9006d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900ac2c0 con 0x7f3e9006d930 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f3e880017f0 con 0x7f3e9006d930 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e94a00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e900accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> v2:172.21.15.150:3300/0 conn(0x7f3e900ad210 0x7f3e9006d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 >> v1:172.21.15.146:6789/0 conn(0x7f3e9006d930 legacy=0x7f3e9015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e740039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e74003f10 0x7f3e74004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e74004cc0 0x7f3e74005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900c95e0 con 0x7f3e74003f10 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900ad660 con 0x7f3e74004cc0 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7400b9d0 con 0x7f3e900abef0 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e74003f10 0x7f3e74004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e94a00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e740039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.585+0000 7f3e95400640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e74004cc0 0x7f3e74005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.586+0000 7f3e87e00640 1 -- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 msgr2=0x7f3e740039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.586+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e900abef0 0x7f3e740039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.586+0000 7f3e87e00640 1 -- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e74004cc0 msgr2=0x7f3e74005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.586+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e74004cc0 0x7f3e74005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.586+0000 7f3e87e00640 1 -- 172.21.15.146:0/4201134240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80009390 con 0x7f3e74003f10 2024-08-17T02:29:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e87e00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e74003f10 0x7f3e74004780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009d60 tx=0x7f3e780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849b3e4a45c232f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78031400 con 0x7f3e74003f10 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7802d050 con 0x7f3e74003f10 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e8fe00640 1 -- 172.21.15.146:0/4201134240 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78031770 con 0x7f3e74003f10 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e95e00640 1 -- 172.21.15.146:0/4201134240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e74003f10 msgr2=0x7f3e74004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e95e00640 1 --2- 172.21.15.146:0/4201134240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e74003f10 0x7f3e74004780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009d60 tx=0x7f3e780090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e95400640 1 -- 172.21.15.146:0/4201134240 reap_dead start 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e95e00640 1 -- 172.21.15.146:0/4201134240 shutdown_connections 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.587+0000 7f3e95e00640 1 -- 172.21.15.146:0/4201134240 >> 172.21.15.146:0/4201134240 conn(0x7f3e90066cd0 msgr2=0x7f3e900670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.588+0000 7f3e95e00640 1 -- 172.21.15.146:0/4201134240 shutdown_connections 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.588+0000 7f3e95e00640 1 -- 172.21.15.146:0/4201134240 wait complete. 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.589+0000 7f3e95e00640 1 Processor -- start 2024-08-17T02:29:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.589+0000 7f3e95e00640 1 -- start start 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e74003f10 0x7f3e90149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1530 0x7f3e900c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900c10a0 con 0x7f3e900c19a0 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9015a2b0 con 0x7f3e900c1530 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900c0770 con 0x7f3e74003f10 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36554/0 (socket says 172.21.15.146:36554) 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 -- 172.21.15.146:0/1574041267 learned_addr learned my addr 172.21.15.146:0/1574041267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e94a00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e74003f10 0x7f3e90149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e87e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1530 0x7f3e900c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 -- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e74003f10 msgr2=0x7f3e90149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e74003f10 0x7f3e90149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 -- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1530 msgr2=0x7f3e900c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1530 0x7f3e900c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.590+0000 7f3e95400640 1 -- 172.21.15.146:0/1574041267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900c0a50 con 0x7f3e900c19a0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e95400640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3e9006e550 tx=0x7f3e9006a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800a7b0 con 0x7f3e900c19a0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800a930 con 0x7f3e900c19a0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800acf0 con 0x7f3e900c19a0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e900c0d30 con 0x7f3e900c19a0 2024-08-17T02:29:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.591+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e90157010 con 0x7f3e900c19a0 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.592+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e900c1210 con 0x7f3e900c19a0 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.593+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e88013600 con 0x7f3e900c19a0 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.594+0000 7f3e8cc00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 0x7f3e6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.594+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3e880829b0 con 0x7f3e900c19a0 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.594+0000 7f3e94a00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 0x7f3e6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.595+0000 7f3e94a00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 0x7f3e6c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e900cc360 tx=0x7f3e800090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.598+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e880506f0 con 0x7f3e900c19a0 2024-08-17T02:29:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.770+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e90071050 con 0x7f3e900c19a0 2024-08-17T02:29:09.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.771+0000 7f3e8cc00640 1 -- 172.21.15.146:0/1574041267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e88053d10 con 0x7f3e900c19a0 2024-08-17T02:29:09.771 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 msgr2=0x7f3e6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 0x7f3e6c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e900cc360 tx=0x7f3e800090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 msgr2=0x7f3e900c26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3e9006e550 tx=0x7f3e9006a7a0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 shutdown_connections 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3e6c065150 0x7f3e6c067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e900c19a0 0x7f3e900c26f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e900c1530 0x7f3e900c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 --2- 172.21.15.146:0/1574041267 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e74003f10 0x7f3e90149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 >> 172.21.15.146:0/1574041267 conn(0x7f3e90066cd0 msgr2=0x7f3e90156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.773+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 shutdown_connections 2024-08-17T02:29:09.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.774+0000 7f3e95e00640 1 -- 172.21.15.146:0/1574041267 wait complete. 2024-08-17T02:29:09.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039307.meta pg_num 2024-08-17T02:29:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.941+0000 7f5592600640 1 Processor -- start 2024-08-17T02:29:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.941+0000 7f5592600640 1 -- start start 2024-08-17T02:29:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.942+0000 7f5592600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f558c0c7db0 0x7f558c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.942+0000 7f5592600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 0x7f558c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.942+0000 7f5592600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c1598f0 con 0x7f558c155a80 2024-08-17T02:29:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.942+0000 7f5592600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c159bd0 con 0x7f558c0c7db0 2024-08-17T02:29:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.942+0000 7f5592600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c159eb0 con 0x7f558c155e50 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f558c0c7db0 0x7f558c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f558c0c7db0 0x7f558c0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36558/0 (socket says 172.21.15.146:36558) 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 -- 172.21.15.146:0/1994054257 learned_addr learned my addr 172.21.15.146:0/1994054257 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 -- 172.21.15.146:0/1994054257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 msgr2=0x7f558c0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558be00640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 0x7f558c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 0x7f558c0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 -- 172.21.15.146:0/1994054257 >> v1:172.21.15.146:6789/0 conn(0x7f558c155a80 legacy=0x7f558c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558aa00640 1 -- 172.21.15.146:0/1994054257 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c15a190 con 0x7f558c0c7db0 2024-08-17T02:29:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558a000640 1 -- 172.21.15.146:0/1994054257 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001360816 0 0) 0x7f558c1598f0 con 0x7f558c155a80 2024-08-17T02:29:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.943+0000 7f558be00640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 0x7f558c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.944+0000 7f558aa00640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c0c8bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5578009910 tx=0x7f55780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bade037da1449c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.944+0000 7f558a000640 1 -- 172.21.15.146:0/1994054257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578032440 con 0x7f558c0c7db0 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.944+0000 7f558a000640 1 -- 172.21.15.146:0/1994054257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55780325a0 con 0x7f558c0c7db0 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.944+0000 7f558a000640 1 -- 172.21.15.146:0/1994054257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578032940 con 0x7f558c0c7db0 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 -- 172.21.15.146:0/1994054257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 msgr2=0x7f558c0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c0c8bd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5578009910 tx=0x7f55780091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 -- 172.21.15.146:0/1994054257 shutdown_connections 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c0c8bd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 --2- 172.21.15.146:0/1994054257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155e50 0x7f558c0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 -- 172.21.15.146:0/1994054257 >> 172.21.15.146:0/1994054257 conn(0x7f558c067750 msgr2=0x7f558c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 -- 172.21.15.146:0/1994054257 shutdown_connections 2024-08-17T02:29:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.945+0000 7f5592600640 1 -- 172.21.15.146:0/1994054257 wait complete. 2024-08-17T02:29:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.946+0000 7f5592600640 1 Processor -- start 2024-08-17T02:29:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 -- start start 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 0x7f558c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c155e50 0x7f558c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c157dc0 con 0x7f558c0c7db0 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1530a0 con 0x7f558c155e50 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.947+0000 7f5592600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c153380 con 0x7f558c155a80 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36560/0 (socket says 172.21.15.146:36560) 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 -- 172.21.15.146:0/1672480386 learned_addr learned my addr 172.21.15.146:0/1672480386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558aa00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 0x7f558c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 -- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 msgr2=0x7f558c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558be00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c155e50 0x7f558c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 0x7f558c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 -- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c155e50 msgr2=0x7f558c1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c155e50 0x7f558c1587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 -- 172.21.15.146:0/1672480386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578009450 con 0x7f558c0c7db0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558aa00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 0x7f558c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.948+0000 7f558b400640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c5e0 tx=0x7f557c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.949+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c012630 con 0x7f558c0c7db0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.949+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0127d0 con 0x7f558c0c7db0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.949+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c012b90 con 0x7f558c0c7db0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.949+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c158e00 con 0x7f558c0c7db0 2024-08-17T02:29:09.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.949+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c0aa6e0 con 0x7f558c0c7db0 2024-08-17T02:29:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.950+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c071050 con 0x7f558c0c7db0 2024-08-17T02:29:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.950+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f557c01b400 con 0x7f558c0c7db0 2024-08-17T02:29:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.951+0000 7f5582a00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 0x7f556c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.951+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f557c082420 con 0x7f558c0c7db0 2024-08-17T02:29:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.951+0000 7f558aa00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 0x7f556c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.952+0000 7f558aa00640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 0x7f556c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5578034000 tx=0x7f5578032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:09.955+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f557c0500c0 con 0x7f558c0c7db0 2024-08-17T02:29:10.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.128+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.meta", "var": "pg_num"} v 0) v1 -- 0x7f558c06aa10 con 0x7f558c0c7db0 2024-08-17T02:29:10.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.129+0000 7f5582a00640 1 -- 172.21.15.146:0/1672480386 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f557c0536e0 con 0x7f558c0c7db0 2024-08-17T02:29:10.129 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:29:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 msgr2=0x7f556c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 0x7f556c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5578034000 tx=0x7f5578032000 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 msgr2=0x7f558c1492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c5e0 tx=0x7f557c007d60 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 shutdown_connections 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f556c065150 0x7f556c067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f558c155e50 0x7f558c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f558c155a80 0x7f558c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 --2- 172.21.15.146:0/1672480386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f558c0c7db0 0x7f558c1492d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 >> 172.21.15.146:0/1672480386 conn(0x7f558c067750 msgr2=0x7f558c150870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 shutdown_connections 2024-08-17T02:29:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.131+0000 7f5592600640 1 -- 172.21.15.146:0/1672480386 wait complete. 2024-08-17T02:29:10.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039307.data pg_num 2024-08-17T02:29:10.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.298+0000 7f0fbde00640 1 Processor -- start 2024-08-17T02:29:10.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.298+0000 7f0fbde00640 1 -- start start 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fbde00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0fb81590b0 0x7f0fb80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fbde00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb806d790 con 0x7f0fb80c9110 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fbde00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb80c9550 con 0x7f0fb8158ce0 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fbde00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb806cb80 con 0x7f0fb81590b0 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fb7400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0fb80c9110 0x7f0fb80aee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39502/0 (socket says 172.21.15.146:39502) 2024-08-17T02:29:10.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fb7400640 1 -- 172.21.15.146:0/4173641614 learned_addr learned my addr 172.21.15.146:0/4173641614 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fb6000640 1 --2- 172.21.15.146:0/4173641614 >> v2:172.21.15.150:3300/0 conn(0x7f0fb81590b0 0x7f0fb80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281105789 0 0) 0x7f0fb806d790 con 0x7f0fb80c9110 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.300+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c0034e0 con 0x7f0fb80c9110 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500551742 0 0) 0x7f0fb80c9550 con 0x7f0fb8158ce0 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb806d790 con 0x7f0fb8158ce0 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698693040 0 0) 0x7f0f9c0034e0 con 0x7f0fb80c9110 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 >> v2:172.21.15.150:3300/0 conn(0x7f0fb81590b0 msgr2=0x7f0fb80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 --2- 172.21.15.146:0/4173641614 >> v2:172.21.15.150:3300/0 conn(0x7f0fb81590b0 0x7f0fb80c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 >> v1:172.21.15.150:6789/0 conn(0x7f0fb8158ce0 legacy=0x7f0fb806a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb806ce60 con 0x7f0fb80c9110 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f0fb00017f0 con 0x7f0fb80c9110 2024-08-17T02:29:10.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 >> v1:172.21.15.146:6789/0 conn(0x7f0fb80c9110 legacy=0x7f0fb80aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c003bb0 0x7f0f9c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 0x7f0f9c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c005180 0x7f0f9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb806cb80 con 0x7f0f9c004780 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c00c0a0 con 0x7f0f9c003bb0 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c00c230 con 0x7f0f9c005180 2024-08-17T02:29:10.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb6000640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 0x7f0f9c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb6000640 1 -- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c005180 msgr2=0x7f0f9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb6000640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c005180 0x7f0f9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.301+0000 7f0fb6000640 1 -- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c003bb0 msgr2=0x7f0f9c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.302+0000 7f0fb6000640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f9c003bb0 0x7f0f9c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.302+0000 7f0fb6000640 1 -- 172.21.15.146:0/4173641614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0034e0 con 0x7f0f9c004780 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.302+0000 7f0fb7400640 1 -- 172.21.15.146:0/4173641614 reap_dead start 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fb6000640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 0x7f0f9c004bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009ba0 tx=0x7f0fa40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7802b36c129aa99 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4031400 con 0x7f0f9c004780 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa402d050 con 0x7f0f9c004780 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fb5600640 1 -- 172.21.15.146:0/4173641614 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4031790 con 0x7f0f9c004780 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 -- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 msgr2=0x7f0f9c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 0x7f0f9c004bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009ba0 tx=0x7f0fa40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 -- 172.21.15.146:0/4173641614 shutdown_connections 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 --2- 172.21.15.146:0/4173641614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f9c004780 0x7f0f9c004bf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 -- 172.21.15.146:0/4173641614 >> 172.21.15.146:0/4173641614 conn(0x7f0fb8067750 msgr2=0x7f0fb80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 -- 172.21.15.146:0/4173641614 shutdown_connections 2024-08-17T02:29:10.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.303+0000 7f0fbde00640 1 -- 172.21.15.146:0/4173641614 wait complete. 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.305+0000 7f0fbde00640 1 Processor -- start 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.305+0000 7f0fbde00640 1 -- start start 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c004780 0x7f0fb8150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fb8168eb0 0x7f0fb8169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81538d0 con 0x7f0fb8169b30 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb815bc50 con 0x7f0fb8168eb0 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fbde00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8151200 con 0x7f0f9c004780 2024-08-17T02:29:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36572/0 (socket says 172.21.15.146:36572) 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6000640 1 -- 172.21.15.146:0/1226388224 learned_addr learned my addr 172.21.15.146:0/1226388224 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6a00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c004780 0x7f0fb8150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb7400640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fb8168eb0 0x7f0fb8169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6000640 1 -- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c004780 msgr2=0x7f0fb8150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.306+0000 7f0fb6000640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c004780 0x7f0fb8150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fb6000640 1 -- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fb8168eb0 msgr2=0x7f0fb8169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fb6000640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fb8168eb0 0x7f0fb8169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fb6000640 1 -- 172.21.15.146:0/1226388224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb815c3d0 con 0x7f0fb8169b30 2024-08-17T02:29:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fb6000640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009bd0 tx=0x7f0fa4035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4030850 con 0x7f0fb8169b30 2024-08-17T02:29:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40309b0 con 0x7f0fb8169b30 2024-08-17T02:29:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4030d70 con 0x7f0fb8169b30 2024-08-17T02:29:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb8159600 con 0x7f0fb8169b30 2024-08-17T02:29:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.307+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb815c0f0 con 0x7f0fb8169b30 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.308+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb8159790 con 0x7f0fb8169b30 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.309+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0fa4045620 con 0x7f0fb8169b30 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.310+0000 7f0fae000640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 0x7f0f98067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.310+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0fa40a3860 con 0x7f0fb8169b30 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.310+0000 7f0fb6a00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 0x7f0f98067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.310+0000 7f0fb6a00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 0x7f0f98067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80acf40 tx=0x7f0fa8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.314+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0fa40715a0 con 0x7f0fb8169b30 2024-08-17T02:29:10.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.486+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.data", "var": "pg_num"} v 0) v1 -- 0x7f0fb8071050 con 0x7f0fb8169b30 2024-08-17T02:29:10.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.487+0000 7f0fae000640 1 -- 172.21.15.146:0/1226388224 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f0fa4074bc0 con 0x7f0fb8169b30 2024-08-17T02:29:10.487 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 msgr2=0x7f0f98067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 0x7f0f98067630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80acf40 tx=0x7f0fa8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 msgr2=0x7f0fb8150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009bd0 tx=0x7f0fa4035000 comp rx=0 tx=0).stop 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 shutdown_connections 2024-08-17T02:29:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0f98065180 0x7f0f98067630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fb8169b30 0x7f0fb8150020 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fb8168eb0 0x7f0fb8169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 --2- 172.21.15.146:0/1226388224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f9c004780 0x7f0fb8150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 >> 172.21.15.146:0/1226388224 conn(0x7f0fb8067750 msgr2=0x7f0fb80aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 shutdown_connections 2024-08-17T02:29:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.489+0000 7f0fbde00640 1 -- 172.21.15.146:0/1226388224 wait complete. 2024-08-17T02:29:10.504 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:10.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.654+0000 7f9784000640 1 Processor -- start 2024-08-17T02:29:10.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.654+0000 7f9784000640 1 -- start start 2024-08-17T02:29:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9784000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9784000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f977c0b1440 0x7f977c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9784000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0caa80 con 0x7f977c140580 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9784000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0cb450 con 0x7f977c0b1440 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9784000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c9e70 con 0x7f977c1401b0 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f977c0b1440 0x7f977c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f977c0b1440 0x7f977c0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36576/0 (socket says 172.21.15.146:36576) 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 -- 172.21.15.146:0/128109566 learned_addr learned my addr 172.21.15.146:0/128109566 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9781600640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 -- 172.21.15.146:0/128109566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 msgr2=0x7f977c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 -- 172.21.15.146:0/128109566 >> v1:172.21.15.150:6789/0 conn(0x7f977c140580 legacy=0x7f977c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.656+0000 7f9782000640 1 -- 172.21.15.146:0/128109566 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0ca150 con 0x7f977c0b1440 2024-08-17T02:29:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.657+0000 7f9782000640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c0c9040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9774009f20 tx=0x7f9774009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980bd712027e110 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f977be00640 1 -- 172.21.15.146:0/128109566 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774031400 con 0x7f977c0b1440 2024-08-17T02:29:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f977be00640 1 -- 172.21.15.146:0/128109566 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977402d050 con 0x7f977c0b1440 2024-08-17T02:29:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f977be00640 1 -- 172.21.15.146:0/128109566 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740317d0 con 0x7f977c0b1440 2024-08-17T02:29:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 -- 172.21.15.146:0/128109566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 msgr2=0x7f977c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c0c9040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9774009f20 tx=0x7f9774009840 comp rx=0 tx=0).stop 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 -- 172.21.15.146:0/128109566 shutdown_connections 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c0c9040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 --2- 172.21.15.146:0/128109566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 -- 172.21.15.146:0/128109566 >> 172.21.15.146:0/128109566 conn(0x7f977c0cb9b0 msgr2=0x7f977c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 -- 172.21.15.146:0/128109566 shutdown_connections 2024-08-17T02:29:10.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.658+0000 7f9784000640 1 -- 172.21.15.146:0/128109566 wait complete. 2024-08-17T02:29:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.660+0000 7f9784000640 1 Processor -- start 2024-08-17T02:29:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.660+0000 7f9784000640 1 -- start start 2024-08-17T02:29:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f977c140580 0x7f977c0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a68f0 con 0x7f977c0b1440 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a5ce0 con 0x7f977c140580 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9784000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a5fc0 con 0x7f977c1401b0 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36592/0 (socket says 172.21.15.146:36592) 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 -- 172.21.15.146:0/200248505 learned_addr learned my addr 172.21.15.146:0/200248505 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 -- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 msgr2=0x7f977c0a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 -- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f977c140580 msgr2=0x7f977c0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f977c140580 0x7f977c0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.661+0000 7f9781600640 1 -- 172.21.15.146:0/200248505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009ae0 con 0x7f977c0b1440 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9781600640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f977000ea20 tx=0x7f97700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000ca10 con 0x7f977c0b1440 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000cb70 con 0x7f977c0b1440 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0a62a0 con 0x7f977c0b1440 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770013470 con 0x7f977c0b1440 2024-08-17T02:29:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.662+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0a5920 con 0x7f977c0b1440 2024-08-17T02:29:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.663+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c064db0 con 0x7f977c0b1440 2024-08-17T02:29:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.664+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9770013820 con 0x7f977c0b1440 2024-08-17T02:29:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.665+0000 7f9778c00640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 0x7f975c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.665+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9770082b10 con 0x7f977c0b1440 2024-08-17T02:29:10.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.665+0000 7f9780c00640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 0x7f975c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.665+0000 7f9780c00640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 0x7f975c067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f977c0adbb0 tx=0x7f9768007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.668+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9770050850 con 0x7f977c0b1440 2024-08-17T02:29:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.876+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977c0adce0 con 0x7f977c0b1440 2024-08-17T02:29:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.876+0000 7f9778c00640 1 -- 172.21.15.146:0/200248505 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f9770017090 con 0x7f977c0b1440 2024-08-17T02:29:10.877 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:10.877 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-08-17T02:29:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.878+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 msgr2=0x7f975c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.878+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 0x7f975c067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f977c0adbb0 tx=0x7f9768007ab0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.878+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 msgr2=0x7f977c13cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.878+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f977000ea20 tx=0x7f97700090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 shutdown_connections 2024-08-17T02:29:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f975c065150 0x7f975c067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f977c140580 0x7f977c0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f977c1401b0 0x7f977c0a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 --2- 172.21.15.146:0/200248505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f977c0b1440 0x7f977c13cf50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 >> 172.21.15.146:0/200248505 conn(0x7f977c0cb9b0 msgr2=0x7f977c0c09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 shutdown_connections 2024-08-17T02:29:10.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:10.879+0000 7f9784000640 1 -- 172.21.15.146:0/200248505 wait complete. 2024-08-17T02:29:10.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:11.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.044+0000 7fa2ba200640 1 Processor -- start 2024-08-17T02:29:11.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.044+0000 7fa2ba200640 1 -- start start 2024-08-17T02:29:11.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.045+0000 7fa2ba200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2b4155180 0x7fa2b40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.045+0000 7fa2ba200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 0x7fa2b406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.045+0000 7fa2ba200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2b40afc10 con 0x7fa2b4155550 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.045+0000 7fa2ba200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2b406ea00 con 0x7fa2b4155180 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.045+0000 7fa2ba200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b40af000 con 0x7fa2b406e080 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2b4155180 0x7fa2b40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2b4155180 0x7fa2b40aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36596/0 (socket says 172.21.15.146:36596) 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 -- 172.21.15.146:0/1607946876 learned_addr learned my addr 172.21.15.146:0/1607946876 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 -- 172.21.15.146:0/1607946876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 msgr2=0x7fa2b406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3e00640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 0x7fa2b406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 0x7fa2b406e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 -- 172.21.15.146:0/1607946876 >> v1:172.21.15.150:6789/0 conn(0x7fa2b4155550 legacy=0x7fa2b40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3400640 1 -- 172.21.15.146:0/1607946876 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b40af2e0 con 0x7fa2b4155180 2024-08-17T02:29:11.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.046+0000 7fa2b3e00640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 0x7fa2b406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.047+0000 7fa2b3400640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b4155180 0x7fa2b40aea20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009910 tx=0x7fa2a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ce26041f0dd2e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.047+0000 7fa2b2000640 1 -- 172.21.15.146:0/1607946876 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a402ae40 con 0x7fa2b4155180 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.047+0000 7fa2b2000640 1 -- 172.21.15.146:0/1607946876 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a4032440 con 0x7fa2b4155180 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.047+0000 7fa2b2000640 1 -- 172.21.15.146:0/1607946876 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4032820 con 0x7fa2b4155180 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 -- 172.21.15.146:0/1607946876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b4155180 msgr2=0x7fa2b40aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b4155180 0x7fa2b40aea20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009910 tx=0x7fa2a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 -- 172.21.15.146:0/1607946876 shutdown_connections 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b406e080 0x7fa2b406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 --2- 172.21.15.146:0/1607946876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b4155180 0x7fa2b40aea20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 -- 172.21.15.146:0/1607946876 >> 172.21.15.146:0/1607946876 conn(0x7fa2b40cb9b0 msgr2=0x7fa2b40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 -- 172.21.15.146:0/1607946876 shutdown_connections 2024-08-17T02:29:11.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.048+0000 7fa2ba200640 1 -- 172.21.15.146:0/1607946876 wait complete. 2024-08-17T02:29:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.049+0000 7fa2ba200640 1 Processor -- start 2024-08-17T02:29:11.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 -- start start 2024-08-17T02:29:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b4155180 0x7fa2b4069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b4155550 0x7fa2b406a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4169530 con 0x7fa2b406e080 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41517e0 con 0x7fa2b4155550 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.050+0000 7fa2ba200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4151ac0 con 0x7fa2b4155180 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36606/0 (socket says 172.21.15.146:36606) 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 -- 172.21.15.146:0/3868190347 learned_addr learned my addr 172.21.15.146:0/3868190347 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 -- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b4155180 msgr2=0x7fa2b4069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b4155180 0x7fa2b4069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 -- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b4155550 msgr2=0x7fa2b406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b4155550 0x7fa2b406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 -- 172.21.15.146:0/3868190347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a4009450 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.051+0000 7fa2b3400640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4035040 tx=0x7fa2a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.052+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4031de0 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.052+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a403d420 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.052+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a403d7e0 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.052+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b4151da0 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.052+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b4151400 con 0x7fa2b406e080 2024-08-17T02:29:11.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.053+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b4064db0 con 0x7fa2b406e080 2024-08-17T02:29:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.053+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa2a4039040 con 0x7fa2b406e080 2024-08-17T02:29:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.054+0000 7fa2aaa00640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 0x7fa294067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.054+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa2a402ae40 con 0x7fa2b406e080 2024-08-17T02:29:11.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.054+0000 7fa2b2a00640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 0x7fa294067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.055+0000 7fa2b2a00640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 0x7fa294067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40aebd0 tx=0x7fa2a0007a70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.058+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa2a40704d0 con 0x7fa2b406e080 2024-08-17T02:29:11.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.232+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2b40cbd80 con 0x7fa2b406e080 2024-08-17T02:29:11.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.233+0000 7fa2aaa00640 1 -- 172.21.15.146:0/3868190347 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fa2a4073af0 con 0x7fa2b406e080 2024-08-17T02:29:11.233 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:11.233 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:27:07.369226+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 msgr2=0x7fa294067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 0x7fa294067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40aebd0 tx=0x7fa2a0007a70 comp rx=0 tx=0).stop 2024-08-17T02:29:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 msgr2=0x7fa2b41482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4035040 tx=0x7fa2a4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 shutdown_connections 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa294065150 0x7fa294067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2b4155550 0x7fa2b406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2b4155180 0x7fa2b4069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 --2- 172.21.15.146:0/3868190347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2b406e080 0x7fa2b41482a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 >> 172.21.15.146:0/3868190347 conn(0x7fa2b40cb9b0 msgr2=0x7fa2b40ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 shutdown_connections 2024-08-17T02:29:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.235+0000 7fa2ba200640 1 -- 172.21.15.146:0/3868190347 wait complete. 2024-08-17T02:29:11.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:11.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.401+0000 7f6b04600640 1 Processor -- start 2024-08-17T02:29:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.401+0000 7f6b04600640 1 -- start start 2024-08-17T02:29:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.402+0000 7f6b04600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.402+0000 7f6b04600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 0x7f6afc0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.402+0000 7f6b04600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0cb560 con 0x7f6afc159350 2024-08-17T02:29:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.402+0000 7f6b04600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0cf7e0 con 0x7f6afc0cf280 2024-08-17T02:29:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.402+0000 7f6b04600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0cfac0 con 0x7f6afc158f80 2024-08-17T02:29:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b02600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 0x7f6afc0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01200640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6afc159350 0x7f6afc0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:58636/0 (socket says 172.21.15.146:58636) 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:60138/0 (socket says 172.21.15.146:60138) 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01200640 1 -- 172.21.15.146:0/3427919360 learned_addr learned my addr 172.21.15.146:0/3427919360 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6afbe00640 1 -- 172.21.15.146:0/3427919360 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701830642 0 0) 0x7f6afc0cb560 con 0x7f6afc159350 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 -- 172.21.15.146:0/3427919360 >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 msgr2=0x7f6afc0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 --2- 172.21.15.146:0/3427919360 >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 0x7f6afc0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 -- 172.21.15.146:0/3427919360 >> v1:172.21.15.150:6789/0 conn(0x7f6afc159350 legacy=0x7f6afc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b01c00640 1 -- 172.21.15.146:0/3427919360 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0caf10 con 0x7f6afc158f80 2024-08-17T02:29:11.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.403+0000 7f6b02600640 1 --2- 172.21.15.146:0/3427919360 >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 0x7f6afc0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.404+0000 7f6b01c00640 1 --2- 172.21.15.146:0/3427919360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009850 tx=0x7f6af00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f453774b59b0f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6afbe00640 1 -- 172.21.15.146:0/3427919360 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af002ad90 con 0x7f6afc158f80 2024-08-17T02:29:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6afbe00640 1 -- 172.21.15.146:0/3427919360 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0032440 con 0x7f6afc158f80 2024-08-17T02:29:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6afbe00640 1 -- 172.21.15.146:0/3427919360 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af00327e0 con 0x7f6afc158f80 2024-08-17T02:29:11.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 -- 172.21.15.146:0/3427919360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 msgr2=0x7f6afc0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 --2- 172.21.15.146:0/3427919360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009850 tx=0x7f6af00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 -- 172.21.15.146:0/3427919360 shutdown_connections 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 --2- 172.21.15.146:0/3427919360 >> v2:172.21.15.150:3300/0 conn(0x7f6afc0cf280 0x7f6afc0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 --2- 172.21.15.146:0/3427919360 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc158f80 0x7f6afc0ca330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 -- 172.21.15.146:0/3427919360 >> 172.21.15.146:0/3427919360 conn(0x7f6afc0cfd90 msgr2=0x7f6afc0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 -- 172.21.15.146:0/3427919360 shutdown_connections 2024-08-17T02:29:11.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.405+0000 7f6b04600640 1 -- 172.21.15.146:0/3427919360 wait complete. 2024-08-17T02:29:11.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.407+0000 7f6b04600640 1 Processor -- start 2024-08-17T02:29:11.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.407+0000 7f6b04600640 1 -- start start 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 0x7f6afc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc159350 0x7f6afc169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc169750 con 0x7f6afc0cf280 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0b4190 con 0x7f6afc158f80 2024-08-17T02:29:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b04600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc16a1e0 con 0x7f6afc159350 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36618/0 (socket says 172.21.15.146:36618) 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01c00640 1 -- 172.21.15.146:0/2967193070 learned_addr learned my addr 172.21.15.146:0/2967193070 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01200640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 0x7f6afc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b02600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc159350 0x7f6afc169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01c00640 1 -- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc159350 msgr2=0x7f6afc169210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.408+0000 7f6b01c00640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc159350 0x7f6afc169210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b01c00640 1 -- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 msgr2=0x7f6afc0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b01c00640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 0x7f6afc0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b01c00640 1 -- 172.21.15.146:0/2967193070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4009a20 con 0x7f6afc0cf280 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b01200640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 0x7f6afc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:11.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b01c00640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009360 tx=0x7f6af0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0000d10 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0031a60 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0031e00 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af0009390 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.409+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc169c20 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.410+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc064db0 con 0x7f6afc0cf280 2024-08-17T02:29:11.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.411+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6af0043030 con 0x7f6afc0cf280 2024-08-17T02:29:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.412+0000 7f6af8c00640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 0x7f6adc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.412+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6af0041070 con 0x7f6afc0cf280 2024-08-17T02:29:11.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.412+0000 7f6b01200640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 0x7f6adc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.413+0000 7f6b01200640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 0x7f6adc067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6afc15a010 tx=0x7f6ae8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.416+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6af0070ce0 con 0x7f6afc0cf280 2024-08-17T02:29:11.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.625+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6afc088e30 con 0x7f6afc0cf280 2024-08-17T02:29:11.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.627+0000 7f6af8c00640 1 -- 172.21.15.146:0/2967193070 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f6af004b090 con 0x7f6afc0cf280 2024-08-17T02:29:11.627 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:11.627 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:11.627 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-08-17T02:29:11.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 msgr2=0x7f6adc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 0x7f6adc067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6afc15a010 tx=0x7f6ae8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:11.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 msgr2=0x7f6afc159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009360 tx=0x7f6af0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 shutdown_connections 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6adc065150 0x7f6adc067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6afc159350 0x7f6afc169210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6afc158f80 0x7f6afc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 --2- 172.21.15.146:0/2967193070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cf280 0x7f6afc159790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 >> 172.21.15.146:0/2967193070 conn(0x7f6afc0cfd90 msgr2=0x7f6afc154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 shutdown_connections 2024-08-17T02:29:11.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.629+0000 7f6b04600640 1 -- 172.21.15.146:0/2967193070 wait complete. 2024-08-17T02:29:11.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.793+0000 7fad56600640 1 Processor -- start 2024-08-17T02:29:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.794+0000 7fad56600640 1 -- start start 2024-08-17T02:29:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad56600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fad500aa8f0 0x7fad5006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad56600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5006b9d0 con 0x7fad5015c230 2024-08-17T02:29:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad56600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5006ebf0 con 0x7fad5015c600 2024-08-17T02:29:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad56600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500aad80 con 0x7fad500aa8f0 2024-08-17T02:29:11.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad4f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad5015c230 0x7fad5006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39512/0 (socket says 172.21.15.146:39512) 2024-08-17T02:29:11.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.795+0000 7fad4f400640 1 -- 172.21.15.146:0/2765706742 learned_addr learned my addr 172.21.15.146:0/2765706742 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad46a00640 1 --2- 172.21.15.146:0/2765706742 >> v2:172.21.15.150:3300/0 conn(0x7fad500aa8f0 0x7fad5006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377525918 0 0) 0x7fad5006b9d0 con 0x7fad5015c230 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad340034e0 con 0x7fad5015c230 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325971544 0 0) 0x7fad5006ebf0 con 0x7fad5015c600 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5006b9d0 con 0x7fad5015c600 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2317473035 0 0) 0x7fad340034e0 con 0x7fad5015c230 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 >> v2:172.21.15.150:3300/0 conn(0x7fad500aa8f0 msgr2=0x7fad5006be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 --2- 172.21.15.146:0/2765706742 >> v2:172.21.15.150:3300/0 conn(0x7fad500aa8f0 0x7fad5006be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 >> v1:172.21.15.150:6789/0 conn(0x7fad5015c600 legacy=0x7fad50066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500ab060 con 0x7fad5015c230 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7fad40001470 con 0x7fad5015c230 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 >> v1:172.21.15.146:6789/0 conn(0x7fad5015c230 legacy=0x7fad5006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 0x7fad34003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34004780 0x7fad34004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad34005130 0x7fad3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500aad80 con 0x7fad34003b60 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c020 con 0x7fad34004780 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.796+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c1e0 con 0x7fad34005130 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 0x7fad34003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad46a00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34004780 0x7fad34004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4fe00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad34005130 0x7fad3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 -- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad34005130 msgr2=0x7fad3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad34005130 0x7fad3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 -- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34004780 msgr2=0x7fad34004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34004780 0x7fad34004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4f400640 1 -- 172.21.15.146:0/2765706742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340034e0 con 0x7fad34003b60 2024-08-17T02:29:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4fe00640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad34005130 0x7fad3400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.797+0000 7fad4fe00640 1 -- 172.21.15.146:0/2765706742 reap_dead start 2024-08-17T02:29:11.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.798+0000 7fad4f400640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 0x7fad34003f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c2d0 tx=0x7fad40001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22db874a69b0a071 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.798+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40005890 con 0x7fad34003b60 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.798+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4002d070 con 0x7fad34003b60 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.798+0000 7fad4ea00640 1 -- 172.21.15.146:0/2765706742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40005a70 con 0x7fad34003b60 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 -- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 msgr2=0x7fad34003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 0x7fad34003f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c2d0 tx=0x7fad40001e10 comp rx=0 tx=0).stop 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 -- 172.21.15.146:0/2765706742 shutdown_connections 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 --2- 172.21.15.146:0/2765706742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34003b60 0x7fad34003f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 -- 172.21.15.146:0/2765706742 >> 172.21.15.146:0/2765706742 conn(0x7fad5006d8f0 msgr2=0x7fad5006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 -- 172.21.15.146:0/2765706742 shutdown_connections 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.799+0000 7fad56600640 1 -- 172.21.15.146:0/2765706742 wait complete. 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.800+0000 7fad56600640 1 Processor -- start 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.800+0000 7fad56600640 1 -- start start 2024-08-17T02:29:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 0x7fad500ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 0x7fad500adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500ca750 con 0x7fad500c9960 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500caa30 con 0x7fad34003b60 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad56600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500cad10 con 0x7fad500ad700 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad46a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad46a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36636/0 (socket says 172.21.15.146:36636) 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.801+0000 7fad46a00640 1 -- 172.21.15.146:0/3476925645 learned_addr learned my addr 172.21.15.146:0/3476925645 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad4f400640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 0x7fad500ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad4fe00640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 0x7fad500adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 -- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 msgr2=0x7fad500adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 0x7fad500adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 -- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 msgr2=0x7fad500ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 0x7fad500ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 -- 172.21.15.146:0/3476925645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500caff0 con 0x7fad500c9960 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad4f400640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 0x7fad500ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad4fe00640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 0x7fad500adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad46a00640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad38011b40 tx=0x7fad380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3800fb00 con 0x7fad500c9960 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800fc60 con 0x7fad500c9960 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38014440 con 0x7fad500c9960 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.802+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500cb2d0 con 0x7fad500c9960 2024-08-17T02:29:11.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.803+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad500c9dd0 con 0x7fad500c9960 2024-08-17T02:29:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.804+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad50064db0 con 0x7fad500c9960 2024-08-17T02:29:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.804+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad380147b0 con 0x7fad500c9960 2024-08-17T02:29:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.805+0000 7fad47400640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 0x7fad2c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.805+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fad38018030 con 0x7fad500c9960 2024-08-17T02:29:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.806+0000 7fad4f400640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 0x7fad2c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.806+0000 7fad4f400640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 0x7fad2c067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad40032000 tx=0x7fad40033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:11.810+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad380b4e40 con 0x7fad500c9960 2024-08-17T02:29:12.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.017+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad500aff90 con 0x7fad500c9960 2024-08-17T02:29:12.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.018+0000 7fad47400640 1 -- 172.21.15.146:0/3476925645 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5693 (secure 0 0 0) 0x7fad38050f60 con 0x7fad500c9960 2024-08-17T02:29:12.019 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:12.019 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:52.667561+0000","modified":"2024-08-17T02:26:56.277620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/4020030705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":4020030705},{"type":"v1","addr":"172.21.15.146:6835","nonce":4020030705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:12.019 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-08-17T02:29:12.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 msgr2=0x7fad2c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 0x7fad2c067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad40032000 tx=0x7fad40033000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 msgr2=0x7fad5013b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad38011b40 tx=0x7fad380090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 shutdown_connections 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fad2c065180 0x7fad2c067630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad500c9960 0x7fad5013b190 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad500ad700 0x7fad500adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 --2- 172.21.15.146:0/3476925645 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad34003b60 0x7fad500ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 >> 172.21.15.146:0/3476925645 conn(0x7fad5006d8f0 msgr2=0x7fad50066cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 shutdown_connections 2024-08-17T02:29:12.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.020+0000 7fad56600640 1 -- 172.21.15.146:0/3476925645 wait complete. 2024-08-17T02:29:12.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:12.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.185+0000 7f7539e00640 1 Processor -- start 2024-08-17T02:29:12.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.185+0000 7f7539e00640 1 -- start start 2024-08-17T02:29:12.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7539e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 0x7f75340aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7539e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 0x7f75340ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7539e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75340afc10 con 0x7f75340acba0 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7539e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75340ae5b0 con 0x7f7534155550 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7539e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75340af000 con 0x7f7534155180 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7533400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f75340acba0 0x7f75340acfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39518/0 (socket says 172.21.15.146:39518) 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.186+0000 7f7533400640 1 -- 172.21.15.146:0/3203810528 learned_addr learned my addr 172.21.15.146:0/3203810528 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532000640 1 --2- 172.21.15.146:0/3203810528 >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 0x7f75340ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532a00640 1 --2- 172.21.15.146:0/3203810528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 0x7f75340aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7531600640 1 -- 172.21.15.146:0/3203810528 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971773891 0 0) 0x7f75340afc10 con 0x7f75340acba0 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7531600640 1 -- 172.21.15.146:0/3203810528 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75180034e0 con 0x7f75340acba0 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532a00640 1 -- 172.21.15.146:0/3203810528 >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 msgr2=0x7f75340ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532a00640 1 --2- 172.21.15.146:0/3203810528 >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 0x7f75340ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532a00640 1 -- 172.21.15.146:0/3203810528 >> v1:172.21.15.146:6789/0 conn(0x7f75340acba0 legacy=0x7f75340acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532a00640 1 -- 172.21.15.146:0/3203810528 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75340af2e0 con 0x7f7534155180 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.187+0000 7f7532000640 1 --2- 172.21.15.146:0/3203810528 >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 0x7f75340ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.188+0000 7f7532a00640 1 --2- 172.21.15.146:0/3203810528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 0x7f75340aea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7524009850 tx=0x7f75240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f79bf9ce67d2b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.188+0000 7f7531600640 1 -- 172.21.15.146:0/3203810528 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752402ad80 con 0x7f7534155180 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.188+0000 7f7531600640 1 -- 172.21.15.146:0/3203810528 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524032440 con 0x7f7534155180 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.188+0000 7f7531600640 1 -- 172.21.15.146:0/3203810528 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524032800 con 0x7f7534155180 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 -- 172.21.15.146:0/3203810528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 msgr2=0x7f75340aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 --2- 172.21.15.146:0/3203810528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 0x7f75340aea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7524009850 tx=0x7f75240090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 -- 172.21.15.146:0/3203810528 shutdown_connections 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 --2- 172.21.15.146:0/3203810528 >> v2:172.21.15.150:3300/0 conn(0x7f7534155550 0x7f75340ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 --2- 172.21.15.146:0/3203810528 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155180 0x7f75340aea20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 -- 172.21.15.146:0/3203810528 >> 172.21.15.146:0/3203810528 conn(0x7f75340cb9b0 msgr2=0x7f75340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 -- 172.21.15.146:0/3203810528 shutdown_connections 2024-08-17T02:29:12.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.189+0000 7f7539e00640 1 -- 172.21.15.146:0/3203810528 wait complete. 2024-08-17T02:29:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.190+0000 7f7539e00640 1 Processor -- start 2024-08-17T02:29:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 -- start start 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7534155180 0x7f753416bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155550 0x7f75340acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534157150 con 0x7f75340acba0 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753416c8b0 con 0x7f7534155180 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.191+0000 7f7539e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753416cb90 con 0x7f7534155550 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36644/0 (socket says 172.21.15.146:36644) 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 -- 172.21.15.146:0/3758244308 learned_addr learned my addr 172.21.15.146:0/3758244308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7533400640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155550 0x7f75340acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532000640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7534155180 0x7f753416bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 -- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155550 msgr2=0x7f75340acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155550 0x7f75340acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 -- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7534155180 msgr2=0x7f753416bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7534155180 0x7f753416bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 -- 172.21.15.146:0/3758244308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009390 con 0x7f75340acba0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.192+0000 7f7532a00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7524009850 tx=0x7f7524032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.193+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524031830 con 0x7f75340acba0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.193+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524031990 con 0x7f75340acba0 2024-08-17T02:29:12.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.193+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524031d70 con 0x7f75340acba0 2024-08-17T02:29:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.193+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7524009390 con 0x7f75340acba0 2024-08-17T02:29:12.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.193+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753414ad60 con 0x7f75340acba0 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.194+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534064db0 con 0x7f75340acba0 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.194+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f752403c400 con 0x7f75340acba0 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.195+0000 7f752a000640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 0x7f7514067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.195+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f75240a27e0 con 0x7f75340acba0 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.196+0000 7f7532000640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 0x7f7514067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.196+0000 7f7532000640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 0x7f7514067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7520009360 tx=0x7f7520008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.199+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f75240705f0 con 0x7f75340acba0 2024-08-17T02:29:12.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.372+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75340b1480 con 0x7f75340acba0 2024-08-17T02:29:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.373+0000 7f752a000640 1 -- 172.21.15.146:0/3758244308 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f75240948f0 con 0x7f75340acba0 2024-08-17T02:29:12.373 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:12.374 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:27:07.369226+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:50.661597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:51.648827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 msgr2=0x7f7514067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 0x7f7514067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7520009360 tx=0x7f7520008040 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 msgr2=0x7f753414a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7524009850 tx=0x7f7524032000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 shutdown_connections 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7514065150 0x7f7514067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7534155550 0x7f75340acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7534155180 0x7f753416bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 --2- 172.21.15.146:0/3758244308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75340acba0 0x7f753414a820 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.375+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 >> 172.21.15.146:0/3758244308 conn(0x7f75340cb9b0 msgr2=0x7f7534152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.376+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 shutdown_connections 2024-08-17T02:29:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.376+0000 7f7539e00640 1 -- 172.21.15.146:0/3758244308 wait complete. 2024-08-17T02:29:12.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.541+0000 7fe6ffe00640 1 Processor -- start 2024-08-17T02:29:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.541+0000 7fe6ffe00640 1 -- start start 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ffe00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe700069170 0x7fe7000695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ffe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe70015c8d0 0x7fe70015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ffe00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe700069b00 con 0x7fe700068510 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ffe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7000688e0 con 0x7fe70015c8d0 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ffe00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70006e540 con 0x7fe700069170 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ff400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe70015c8d0 0x7fe70015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ff400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe70015c8d0 0x7fe70015ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36660/0 (socket says 172.21.15.146:36660) 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6ff400640 1 -- 172.21.15.146:0/3632451537 learned_addr learned my addr 172.21.15.146:0/3632451537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.542+0000 7fe6fe000640 1 --2- 172.21.15.146:0/3632451537 >> v2:172.21.15.150:3300/0 conn(0x7fe700069170 0x7fe7000695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.543+0000 7fe6ff400640 1 -- 172.21.15.146:0/3632451537 >> v2:172.21.15.150:3300/0 conn(0x7fe700069170 msgr2=0x7fe7000695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.543+0000 7fe6ff400640 1 --2- 172.21.15.146:0/3632451537 >> v2:172.21.15.150:3300/0 conn(0x7fe700069170 0x7fe7000695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.543+0000 7fe6ff400640 1 -- 172.21.15.146:0/3632451537 >> v1:172.21.15.150:6789/0 conn(0x7fe700068510 legacy=0x7fe70006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.543+0000 7fe6ff400640 1 -- 172.21.15.146:0/3632451537 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70006d0b0 con 0x7fe70015c8d0 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6ff400640 1 --2- 172.21.15.146:0/3632451537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe70015c8d0 0x7fe70015ccf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe700076e00 tx=0x7fe6f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c6a0ceb9b4c1da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6fd600640 1 -- 172.21.15.146:0/3632451537 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8031400 con 0x7fe70015c8d0 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6fd600640 1 -- 172.21.15.146:0/3632451537 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f802d050 con 0x7fe70015c8d0 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6fd600640 1 -- 172.21.15.146:0/3632451537 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80317d0 con 0x7fe70015c8d0 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6ffe00640 1 -- 172.21.15.146:0/3632451537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe70015c8d0 msgr2=0x7fe70015ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.544+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/3632451537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe70015c8d0 0x7fe70015ccf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe700076e00 tx=0x7fe6f8009840 comp rx=0 tx=0).stop 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 -- 172.21.15.146:0/3632451537 shutdown_connections 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/3632451537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe70015c8d0 0x7fe70015ccf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/3632451537 >> v2:172.21.15.150:3300/0 conn(0x7fe700069170 0x7fe7000695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 -- 172.21.15.146:0/3632451537 >> 172.21.15.146:0/3632451537 conn(0x7fe7000cc040 msgr2=0x7fe7000cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 -- 172.21.15.146:0/3632451537 shutdown_connections 2024-08-17T02:29:12.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.545+0000 7fe6ffe00640 1 -- 172.21.15.146:0/3632451537 wait complete. 2024-08-17T02:29:12.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.546+0000 7fe6ffe00640 1 Processor -- start 2024-08-17T02:29:12.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.546+0000 7fe6ffe00640 1 -- start start 2024-08-17T02:29:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe700069170 0x7fe7001568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe70015c8d0 0x7fe7000affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70015d8a0 con 0x7fe700068510 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700097120 con 0x7fe700069170 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ffe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001574b0 con 0x7fe70015c8d0 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6fea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36672/0 (socket says 172.21.15.146:36672) 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6fea00640 1 -- 172.21.15.146:0/1896321489 learned_addr learned my addr 172.21.15.146:0/1896321489 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6ff400640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe70015c8d0 0x7fe7000affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.547+0000 7fe6fe000640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe700069170 0x7fe7001568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 -- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe70015c8d0 msgr2=0x7fe7000affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe70015c8d0 0x7fe7000affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 -- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe700069170 msgr2=0x7fe7001568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe700069170 0x7fe7001568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 -- 172.21.15.146:0/1896321489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8009ae0 con 0x7fe700068510 2024-08-17T02:29:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6fea00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000c560 tx=0x7fe6f0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011590 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f0011710 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011ad0 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe700096b10 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.548+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000c84d0 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.549+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70015c730 con 0x7fe700068510 2024-08-17T02:29:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.550+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe6f001b3b0 con 0x7fe700068510 2024-08-17T02:29:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.551+0000 7fe6f6000640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 0x7fe6e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.551+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe6f0081d60 con 0x7fe700068510 2024-08-17T02:29:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.551+0000 7fe6fe000640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 0x7fe6e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.552+0000 7fe6fe000640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 0x7fe6e0067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe70006ac10 tx=0x7fe6ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.555+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe70015c730 con 0x7fe700068510 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.767+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe70015c730 con 0x7fe700068510 2024-08-17T02:29:12.767 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-08-17T02:29:12.767+0000 7fd403600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.772+0000 7fe6f6000640 1 -- 172.21.15.146:0/1896321489 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe70015c730 con 0x7fe700068510 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 msgr2=0x7fe6e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 0x7fe6e0067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe70006ac10 tx=0x7fe6ec008040 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 msgr2=0x7fe7000b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000c560 tx=0x7fe6f0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 shutdown_connections 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe6e0065150 0x7fe6e0067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe70015c8d0 0x7fe7000affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe700069170 0x7fe7001568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 --2- 172.21.15.146:0/1896321489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe700068510 0x7fe7000b0e70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.774+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 >> 172.21.15.146:0/1896321489 conn(0x7fe7000cc040 msgr2=0x7fe70006fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.775+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 shutdown_connections 2024-08-17T02:29:12.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.775+0000 7fe6ffe00640 1 -- 172.21.15.146:0/1896321489 wait complete. 2024-08-17T02:29:12.783 INFO:tasks.ceph.mds.a.smithi146.stderr: -7228> 2024-08-17T02:26:56.219+0000 7f9e24000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:12.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:12.830 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-08-17T02:29:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.946+0000 7f484d200640 1 Processor -- start 2024-08-17T02:29:12.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.946+0000 7f484d200640 1 -- start start 2024-08-17T02:29:12.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f484d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f48480b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f484d200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4848159010 0x7f48481629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f484d200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480ad8c0 con 0x7f48480b2c40 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f484d200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48480ade80 con 0x7f4848159010 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f484d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48480af320 con 0x7f4848158c40 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.947+0000 7f4846800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4848159010 0x7f48481629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4848159010 0x7f48481629d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36704/0 (socket says 172.21.15.146:36704) 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 -- 172.21.15.146:0/754609384 learned_addr learned my addr 172.21.15.146:0/754609384 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:12.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4845e00640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f48480b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 -- 172.21.15.146:0/754609384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 msgr2=0x7f48480b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f48480b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 -- 172.21.15.146:0/754609384 >> v1:172.21.15.150:6789/0 conn(0x7f48480b2c40 legacy=0x7f48480b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.948+0000 7f4846800640 1 -- 172.21.15.146:0/754609384 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480b0180 con 0x7f4848159010 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.949+0000 7f4846800640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4848159010 0x7f48481629d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4840009940 tx=0x7f48400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f3b710c3241c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.949+0000 7f4845400640 1 -- 172.21.15.146:0/754609384 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484002adb0 con 0x7f4848159010 2024-08-17T02:29:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.949+0000 7f4845400640 1 -- 172.21.15.146:0/754609384 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4840032440 con 0x7f4848159010 2024-08-17T02:29:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.949+0000 7f4845400640 1 -- 172.21.15.146:0/754609384 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840032820 con 0x7f4848159010 2024-08-17T02:29:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 -- 172.21.15.146:0/754609384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4848159010 msgr2=0x7f48481629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4848159010 0x7f48481629d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4840009940 tx=0x7f48400091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 -- 172.21.15.146:0/754609384 shutdown_connections 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4848159010 0x7f48481629d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 --2- 172.21.15.146:0/754609384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f48480b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 -- 172.21.15.146:0/754609384 >> 172.21.15.146:0/754609384 conn(0x7f48480cfd80 msgr2=0x7f48480d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 -- 172.21.15.146:0/754609384 shutdown_connections 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.950+0000 7f484d200640 1 -- 172.21.15.146:0/754609384 wait complete. 2024-08-17T02:29:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.951+0000 7f484d200640 1 Processor -- start 2024-08-17T02:29:12.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.951+0000 7f484d200640 1 -- start start 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f484815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4848159010 0x7f4848152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484809a280 con 0x7f48480b2c40 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484815cac0 con 0x7f4848159010 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.952+0000 7f484d200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484815d8e0 con 0x7f4848158c40 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36706/0 (socket says 172.21.15.146:36706) 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 -- 172.21.15.146:0/3139405454 learned_addr learned my addr 172.21.15.146:0/3139405454 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4846800640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4848159010 0x7f4848152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f483d400640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f484815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 -- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 msgr2=0x7f484815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f484815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 -- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4848159010 msgr2=0x7f4848152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4848159010 0x7f4848152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 -- 172.21.15.146:0/3139405454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840009450 con 0x7f48480b2c40 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f4845e00640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4838009ef0 tx=0x7f483800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.953+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800ce10 con 0x7f48480b2c40 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.954+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800f040 con 0x7f48480b2c40 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.954+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484815ccd0 con 0x7f48480b2c40 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.954+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380146b0 con 0x7f48480b2c40 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.954+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484815d060 con 0x7f48480b2c40 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.955+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4848071050 con 0x7f48480b2c40 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.955+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4838014a20 con 0x7f48480b2c40 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.956+0000 7f483e000640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 0x7f4824067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.956+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f48380836b0 con 0x7f48480b2c40 2024-08-17T02:29:12.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.957+0000 7f483d400640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 0x7f4824067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.957+0000 7f483d400640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 0x7f4824067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f484809cd30 tx=0x7f4830009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:12.961+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48380512f0 con 0x7f48480b2c40 2024-08-17T02:29:13.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.169+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f484815d630 con 0x7f48480b2c40 2024-08-17T02:29:13.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.773+0000 7f483e000640 1 -- 172.21.15.146:0/3139405454 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4838054910 con 0x7f48480b2c40 2024-08-17T02:29:13.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 msgr2=0x7f4824067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 0x7f4824067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f484809cd30 tx=0x7f4830009040 comp rx=0 tx=0).stop 2024-08-17T02:29:13.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 msgr2=0x7f4848169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4838009ef0 tx=0x7f483800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:13.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 shutdown_connections 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4824065150 0x7f4824067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4848159010 0x7f4848152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4848158c40 0x7f484815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 --2- 172.21.15.146:0/3139405454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48480b2c40 0x7f4848169ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 >> 172.21.15.146:0/3139405454 conn(0x7f48480cfd80 msgr2=0x7f48480680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 shutdown_connections 2024-08-17T02:29:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.776+0000 7f484d200640 1 -- 172.21.15.146:0/3139405454 wait complete. 2024-08-17T02:29:13.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:13.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.986+0000 7f4ffa200640 1 Processor -- start 2024-08-17T02:29:13.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.986+0000 7f4ffa200640 1 -- start start 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.987+0000 7f4ffa200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ff416edb0 0x7f4ff4171190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.987+0000 7f4ffa200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40aa850 con 0x7f4ff40ae1a0 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.987+0000 7f4ffa200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40ac650 con 0x7f4ff4087300 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.987+0000 7f4ffa200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40ab690 con 0x7f4ff416edb0 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.987+0000 7f4ff3e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ff416edb0 0x7f4ff4171190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.988+0000 7f4ff2a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ff40ae1a0 0x7f4ff416d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39532/0 (socket says 172.21.15.146:39532) 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.988+0000 7f4ff2a00640 1 -- 172.21.15.146:0/1565165243 learned_addr learned my addr 172.21.15.146:0/1565165243 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.988+0000 7f4ff3e00640 1 -- 172.21.15.146:0/1565165243 >> v1:172.21.15.150:6789/0 conn(0x7f4ff4087300 legacy=0x7f4ff40876d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.988+0000 7f4ff3e00640 1 -- 172.21.15.146:0/1565165243 >> v1:172.21.15.146:6789/0 conn(0x7f4ff40ae1a0 legacy=0x7f4ff416d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.988+0000 7f4ff3e00640 1 -- 172.21.15.146:0/1565165243 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40aaf50 con 0x7f4ff416edb0 2024-08-17T02:29:13.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.989+0000 7f4ff3e00640 1 --2- 172.21.15.146:0/1565165243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4171190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e60 tx=0x7f4fec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f3c91a40621407 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.989+0000 7f4ff2000640 1 -- 172.21.15.146:0/1565165243 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec007550 con 0x7f4ff416edb0 2024-08-17T02:29:13.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.989+0000 7f4ff2000640 1 -- 172.21.15.146:0/1565165243 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec02d050 con 0x7f4ff416edb0 2024-08-17T02:29:13.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.989+0000 7f4ff2000640 1 -- 172.21.15.146:0/1565165243 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec007900 con 0x7f4ff416edb0 2024-08-17T02:29:13.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 -- 172.21.15.146:0/1565165243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 msgr2=0x7f4ff4171190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 --2- 172.21.15.146:0/1565165243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4171190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e60 tx=0x7f4fec009780 comp rx=0 tx=0).stop 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 -- 172.21.15.146:0/1565165243 shutdown_connections 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 --2- 172.21.15.146:0/1565165243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4171190 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 -- 172.21.15.146:0/1565165243 >> 172.21.15.146:0/1565165243 conn(0x7f4ff4067750 msgr2=0x7f4ff406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 -- 172.21.15.146:0/1565165243 shutdown_connections 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.990+0000 7f4ffa200640 1 -- 172.21.15.146:0/1565165243 wait complete. 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.991+0000 7f4ffa200640 1 Processor -- start 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.991+0000 7f4ffa200640 1 -- start start 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 0x7f4ff415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ff40ae1a0 0x7f4ff4178f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40a90c0 con 0x7f4ff416edb0 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40a9380 con 0x7f4ff4087300 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ffa200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40a9660 con 0x7f4ff40ae1a0 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ff3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ff3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36722/0 (socket says 172.21.15.146:36722) 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.992+0000 7f4ff3e00640 1 -- 172.21.15.146:0/984978831 learned_addr learned my addr 172.21.15.146:0/984978831 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3400640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 0x7f4ff415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 -- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ff40ae1a0 msgr2=0x7f4ff4178f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ff40ae1a0 0x7f4ff4178f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 -- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 msgr2=0x7f4ff415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 0x7f4ff415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 -- 172.21.15.146:0/984978831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009a20 con 0x7f4ff416edb0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3400640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 0x7f4ff415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ff3e00640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097c0 tx=0x7f4fec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec031cc0 con 0x7f4ff416edb0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec031e20 con 0x7f4ff416edb0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec03c630 con 0x7f4ff416edb0 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.993+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff40a9940 con 0x7f4ff416edb0 2024-08-17T02:29:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.994+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff4179b40 con 0x7f4ff416edb0 2024-08-17T02:29:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.995+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff40a5810 con 0x7f4ff416edb0 2024-08-17T02:29:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.995+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fec003040 con 0x7f4ff416edb0 2024-08-17T02:29:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.996+0000 7f4feaa00640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 0x7f4fd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.996+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f4fec0a41c0 con 0x7f4ff416edb0 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.996+0000 7f4ff3400640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 0x7f4fd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:13.997+0000 7f4ff3400640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 0x7f4fd4067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ff406f060 tx=0x7f4fe4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.000+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ff40a5810 con 0x7f4ff416edb0 2024-08-17T02:29:14.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.172+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ff40a5810 con 0x7f4ff416edb0 2024-08-17T02:29:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.781+0000 7f4feaa00640 1 -- 172.21.15.146:0/984978831 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4ff40a5810 con 0x7f4ff416edb0 2024-08-17T02:29:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 msgr2=0x7f4fd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 0x7f4fd4067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ff406f060 tx=0x7f4fe4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 msgr2=0x7f4ff4179490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097c0 tx=0x7f4fec037000 comp rx=0 tx=0).stop 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 shutdown_connections 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4fd4065150 0x7f4fd4067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff416edb0 0x7f4ff4179490 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4ff40ae1a0 0x7f4ff4178f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 --2- 172.21.15.146:0/984978831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ff4087300 0x7f4ff415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 >> 172.21.15.146:0/984978831 conn(0x7f4ff4067750 msgr2=0x7f4ff4163090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 shutdown_connections 2024-08-17T02:29:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.785+0000 7f4ffa200640 1 -- 172.21.15.146:0/984978831 wait complete. 2024-08-17T02:29:14.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.957+0000 7f423fa00640 1 Processor -- start 2024-08-17T02:29:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.957+0000 7f423fa00640 1 -- start start 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423fa00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4238158c10 0x7f42380cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423fa00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f42380673e0 0x7f423806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423fa00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423806a2c0 con 0x7f42380c9480 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423fa00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380a9d30 con 0x7f4238158c10 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423fa00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423806a510 con 0x7f42380673e0 2024-08-17T02:29:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4238158c10 0x7f42380cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f423d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4238158c10 0x7f42380cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37364/0 (socket says 172.21.15.146:37364) 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.958+0000 7f4237e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f42380c9480 0x7f4238066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44364/0 (socket says 172.21.15.146:44364) 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423d000640 1 -- 172.21.15.146:0/756841661 learned_addr learned my addr 172.21.15.146:0/756841661 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423da00640 1 --2- 172.21.15.146:0/756841661 >> v2:172.21.15.150:3300/0 conn(0x7f42380673e0 0x7f423806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423d000640 1 -- 172.21.15.146:0/756841661 >> v2:172.21.15.150:3300/0 conn(0x7f42380673e0 msgr2=0x7f423806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423d000640 1 --2- 172.21.15.146:0/756841661 >> v2:172.21.15.150:3300/0 conn(0x7f42380673e0 0x7f423806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423d000640 1 -- 172.21.15.146:0/756841661 >> v1:172.21.15.146:6789/0 conn(0x7f42380c9480 legacy=0x7f4238066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.959+0000 7f423d000640 1 -- 172.21.15.146:0/756841661 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423806a7f0 con 0x7f4238158c10 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.960+0000 7f423d000640 1 --2- 172.21.15.146:0/756841661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238158c10 0x7f42380cd590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42380aa010 tx=0x7f422c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ec78a97a1af927 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.960+0000 7f4237400640 1 -- 172.21.15.146:0/756841661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c02ae80 con 0x7f4238158c10 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.960+0000 7f4237400640 1 -- 172.21.15.146:0/756841661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c032440 con 0x7f4238158c10 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.960+0000 7f4237400640 1 -- 172.21.15.146:0/756841661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c032800 con 0x7f4238158c10 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 -- 172.21.15.146:0/756841661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238158c10 msgr2=0x7f42380cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 --2- 172.21.15.146:0/756841661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238158c10 0x7f42380cd590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42380aa010 tx=0x7f422c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 -- 172.21.15.146:0/756841661 shutdown_connections 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 --2- 172.21.15.146:0/756841661 >> v2:172.21.15.150:3300/0 conn(0x7f42380673e0 0x7f423806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 --2- 172.21.15.146:0/756841661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4238158c10 0x7f42380cd590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 -- 172.21.15.146:0/756841661 >> 172.21.15.146:0/756841661 conn(0x7f42380cca80 msgr2=0x7f42380cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 -- 172.21.15.146:0/756841661 shutdown_connections 2024-08-17T02:29:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.961+0000 7f423fa00640 1 -- 172.21.15.146:0/756841661 wait complete. 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.962+0000 7f423fa00640 1 Processor -- start 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.962+0000 7f423fa00640 1 -- start start 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 0x7f4238149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4238158c10 0x7f42380b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423814fc90 con 0x7f42380673e0 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423814ff70 con 0x7f42380c9480 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423fa00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4238150250 con 0x7f4238158c10 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37372/0 (socket says 172.21.15.146:37372) 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.963+0000 7f423d000640 1 -- 172.21.15.146:0/3290062209 learned_addr learned my addr 172.21.15.146:0/3290062209 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f4237e00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 0x7f4238149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423da00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4238158c10 0x7f42380b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 -- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4238158c10 msgr2=0x7f42380b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4238158c10 0x7f42380b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 -- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 msgr2=0x7f4238149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 0x7f4238149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 -- 172.21.15.146:0/3290062209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009450 con 0x7f42380673e0 2024-08-17T02:29:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f4237e00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 0x7f4238149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423d000640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f422c009210 tx=0x7f422c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c000d10 con 0x7f42380673e0 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c031de0 con 0x7f42380673e0 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c03d690 con 0x7f42380673e0 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.964+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238150530 con 0x7f42380673e0 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.965+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4238149970 con 0x7f42380673e0 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.966+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42380710c0 con 0x7f42380673e0 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.966+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f422c039040 con 0x7f42380673e0 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.967+0000 7f422be00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 0x7f4218067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.968+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f422c0a26e0 con 0x7f42380673e0 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.968+0000 7f4237e00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 0x7f4218067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.968+0000 7f4237e00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 0x7f4218067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f423814c410 tx=0x7f4224009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:14.972+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f422c0704e0 con 0x7f42380673e0 2024-08-17T02:29:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.144+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f42380aa6d0 con 0x7f42380673e0 2024-08-17T02:29:15.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.782+0000 7f422be00640 1 -- 172.21.15.146:0/3290062209 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f422c073b00 con 0x7f42380673e0 2024-08-17T02:29:15.783 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 msgr2=0x7f4218067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 0x7f4218067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f423814c410 tx=0x7f4224009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 msgr2=0x7f423814f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f422c009210 tx=0x7f422c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 shutdown_connections 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f4218065150 0x7f4218067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4238158c10 0x7f42380b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42380c9480 0x7f4238149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 --2- 172.21.15.146:0/3290062209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42380673e0 0x7f423814f440 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.787+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 >> 172.21.15.146:0/3290062209 conn(0x7f42380cca80 msgr2=0x7f42380c9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.789+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 shutdown_connections 2024-08-17T02:29:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.789+0000 7f423fa00640 1 -- 172.21.15.146:0/3290062209 wait complete. 2024-08-17T02:29:15.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.961+0000 7face9e00640 1 Processor -- start 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.961+0000 7face9e00640 1 -- start start 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.962+0000 7face9e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7face406ddf0 0x7face4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.962+0000 7face9e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40a9a10 con 0x7face40aa7d0 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.962+0000 7face9e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face40a9cf0 con 0x7face406da20 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.962+0000 7face9e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40ac400 con 0x7face406ddf0 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face2000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7face40aa7d0 0x7face40ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44374/0 (socket says 172.21.15.146:44374) 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face2000640 1 -- 172.21.15.146:0/1924964019 learned_addr learned my addr 172.21.15.146:0/1924964019 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face3400640 1 --2- 172.21.15.146:0/1924964019 >> v2:172.21.15.146:3300/0 conn(0x7face406ddf0 0x7face4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face1600640 1 -- 172.21.15.146:0/1924964019 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095126194 0 0) 0x7face40a9a10 con 0x7face40aa7d0 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face3400640 1 -- 172.21.15.146:0/1924964019 >> v1:172.21.15.150:6789/0 conn(0x7face406da20 legacy=0x7face4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face3400640 1 -- 172.21.15.146:0/1924964019 >> v1:172.21.15.146:6789/0 conn(0x7face40aa7d0 legacy=0x7face40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.963+0000 7face3400640 1 -- 172.21.15.146:0/1924964019 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40a9fd0 con 0x7face406ddf0 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.964+0000 7face3400640 1 --2- 172.21.15.146:0/1924964019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face4158fa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7facdc009e60 tx=0x7facdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c209a1e184a28735 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.964+0000 7face1600640 1 -- 172.21.15.146:0/1924964019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc007550 con 0x7face406ddf0 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.964+0000 7face1600640 1 -- 172.21.15.146:0/1924964019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc02d050 con 0x7face406ddf0 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.964+0000 7face1600640 1 -- 172.21.15.146:0/1924964019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0078e0 con 0x7face406ddf0 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 -- 172.21.15.146:0/1924964019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 msgr2=0x7face4158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 --2- 172.21.15.146:0/1924964019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face4158fa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7facdc009e60 tx=0x7facdc009780 comp rx=0 tx=0).stop 2024-08-17T02:29:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 -- 172.21.15.146:0/1924964019 shutdown_connections 2024-08-17T02:29:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 --2- 172.21.15.146:0/1924964019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face4158fa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 -- 172.21.15.146:0/1924964019 >> 172.21.15.146:0/1924964019 conn(0x7face40cb9b0 msgr2=0x7face40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 -- 172.21.15.146:0/1924964019 shutdown_connections 2024-08-17T02:29:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.965+0000 7face9e00640 1 -- 172.21.15.146:0/1924964019 wait complete. 2024-08-17T02:29:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.966+0000 7face9e00640 1 Processor -- start 2024-08-17T02:29:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 -- start start 2024-08-17T02:29:15.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 0x7face41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7face40aa7d0 0x7face4158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face415b4a0 con 0x7face406ddf0 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face415b740 con 0x7face406da20 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.967+0000 7face9e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face415ba20 con 0x7face40aa7d0 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37390/0 (socket says 172.21.15.146:37390) 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 -- 172.21.15.146:0/551278668 learned_addr learned my addr 172.21.15.146:0/551278668 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2a00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 0x7face41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face3400640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7face40aa7d0 0x7face4158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 -- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7face40aa7d0 msgr2=0x7face4158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7face40aa7d0 0x7face4158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 -- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 msgr2=0x7face41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 0x7face41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 -- 172.21.15.146:0/551278668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc009a20 con 0x7face406ddf0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2a00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 0x7face41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7face2000640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7facd000c510 tx=0x7facd0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.968+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0005aa0 con 0x7face406ddf0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.969+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd0005c00 con 0x7face406ddf0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.969+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd00070d0 con 0x7face406ddf0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.969+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face415bd00 con 0x7face406ddf0 2024-08-17T02:29:15.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.969+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face4153f20 con 0x7face406ddf0 2024-08-17T02:29:15.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.970+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face415c200 con 0x7face406ddf0 2024-08-17T02:29:15.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.971+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7facd0007500 con 0x7face406ddf0 2024-08-17T02:29:15.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.971+0000 7facda000640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 0x7facc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.972+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7facd00819f0 con 0x7face406ddf0 2024-08-17T02:29:15.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.972+0000 7face2a00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 0x7facc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.972+0000 7face2a00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 0x7facc4067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7face40c7f60 tx=0x7facd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:15.975+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7facd004fa30 con 0x7face406ddf0 2024-08-17T02:29:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.158+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7face4064db0 con 0x7face406ddf0 2024-08-17T02:29:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.159+0000 7facda000640 1 -- 172.21.15.146:0/551278668 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7facd0017090 con 0x7face406ddf0 2024-08-17T02:29:16.159 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:16.159 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:29:15.777789+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/4020030705":"2024-08-18T02:29:12.767829+0000","172.21.15.146:6834/4020030705":"2024-08-18T02:29:12.767829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:16.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 msgr2=0x7facc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 0x7facc4067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7face40c7f60 tx=0x7facd4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 msgr2=0x7face415d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7facd000c510 tx=0x7facd0007f30 comp rx=0 tx=0).stop 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 shutdown_connections 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7facc4065150 0x7facc4067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7face406ddf0 0x7face415d410 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7face40aa7d0 0x7face4158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 --2- 172.21.15.146:0/551278668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7face406da20 0x7face41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 >> 172.21.15.146:0/551278668 conn(0x7face40cb9b0 msgr2=0x7face406fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 shutdown_connections 2024-08-17T02:29:16.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.161+0000 7face9e00640 1 -- 172.21.15.146:0/551278668 wait complete. 2024-08-17T02:29:16.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:50.375100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001039307.meta', 'create_time': '2024-08-17T02:27:03.475416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001039307'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001039307.data', 'create_time': '2024-08-17T02:27:04.382680+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001039307'}}}] 2024-08-17T02:29:16.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.328+0000 7ff736a00640 1 Processor -- start 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.329+0000 7ff736a00640 1 -- start start 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff736a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 0x7ff730154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff736a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff730155250 0x7ff7300acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff736a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7300c83e0 con 0x7ff73006d9e0 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff736a00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7300aed90 con 0x7ff730155250 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff736a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300af070 con 0x7ff73006ddb0 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff734a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff730155250 0x7ff7300acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff734a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff730155250 0x7ff7300acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37402/0 (socket says 172.21.15.146:37402) 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.330+0000 7ff734a00640 1 -- 172.21.15.146:0/1307132078 learned_addr learned my addr 172.21.15.146:0/1307132078 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff72f400640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 0x7ff730154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff734a00640 1 -- 172.21.15.146:0/1307132078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 msgr2=0x7ff730154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff734a00640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 0x7ff730154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff734a00640 1 -- 172.21.15.146:0/1307132078 >> v1:172.21.15.150:6789/0 conn(0x7ff73006d9e0 legacy=0x7ff7300cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff734a00640 1 -- 172.21.15.146:0/1307132078 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7300cb7d0 con 0x7ff730155250 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.331+0000 7ff72f400640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 0x7ff730154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.332+0000 7ff734a00640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff730155250 0x7ff7300acc70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff728009f20 tx=0x7ff728009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd6ff993af3893c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.332+0000 7ff72ea00640 1 -- 172.21.15.146:0/1307132078 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728031400 con 0x7ff730155250 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.332+0000 7ff72ea00640 1 -- 172.21.15.146:0/1307132078 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72802d050 con 0x7ff730155250 2024-08-17T02:29:16.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.332+0000 7ff72ea00640 1 -- 172.21.15.146:0/1307132078 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280317d0 con 0x7ff730155250 2024-08-17T02:29:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 -- 172.21.15.146:0/1307132078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff730155250 msgr2=0x7ff7300acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff730155250 0x7ff7300acc70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff728009f20 tx=0x7ff728009840 comp rx=0 tx=0).stop 2024-08-17T02:29:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 -- 172.21.15.146:0/1307132078 shutdown_connections 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff730155250 0x7ff7300acc70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 --2- 172.21.15.146:0/1307132078 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006ddb0 0x7ff730154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 -- 172.21.15.146:0/1307132078 >> 172.21.15.146:0/1307132078 conn(0x7ff730067750 msgr2=0x7ff7300cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 -- 172.21.15.146:0/1307132078 shutdown_connections 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.333+0000 7ff736a00640 1 -- 172.21.15.146:0/1307132078 wait complete. 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.334+0000 7ff736a00640 1 Processor -- start 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.334+0000 7ff736a00640 1 -- start start 2024-08-17T02:29:16.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006d9e0 0x7ff73014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 0x7ff730157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730151ce0 con 0x7ff73006ddb0 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff730152ae0 con 0x7ff730155250 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.335+0000 7ff736a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7300ade90 con 0x7ff73006d9e0 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37406/0 (socket says 172.21.15.146:37406) 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 -- 172.21.15.146:0/3086884619 learned_addr learned my addr 172.21.15.146:0/3086884619 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72fe00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006d9e0 0x7ff73014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff734a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 0x7ff730157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 -- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006d9e0 msgr2=0x7ff73014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006d9e0 0x7ff73014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 -- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 msgr2=0x7ff730157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 0x7ff730157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 -- 172.21.15.146:0/3086884619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009ae0 con 0x7ff73006ddb0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff734a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 0x7ff730157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.336+0000 7ff72f400640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00d890 tx=0x7ff71c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.337+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00de80 con 0x7ff73006ddb0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.337+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00b8d0 con 0x7ff73006ddb0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.337+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff730151ed0 con 0x7ff73006ddb0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.337+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00bc90 con 0x7ff73006ddb0 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.337+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff730152490 con 0x7ff73006ddb0 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.338+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff730064db0 con 0x7ff73006ddb0 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.339+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff71c01e460 con 0x7ff73006ddb0 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.339+0000 7ff727400640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 0x7ff710067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.339+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff71c082be0 con 0x7ff73006ddb0 2024-08-17T02:29:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.340+0000 7ff72fe00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 0x7ff710067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.340+0000 7ff72fe00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 0x7ff710067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff720007fd0 tx=0x7ff720007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.343+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff71c050b80 con 0x7ff73006ddb0 2024-08-17T02:29:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.516+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff73006e970 con 0x7ff73006ddb0 2024-08-17T02:29:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.517+0000 7ff727400640 1 -- 172.21.15.146:0/3086884619 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff71c0541a0 con 0x7ff73006ddb0 2024-08-17T02:29:16.517 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-08-17T02:29:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 msgr2=0x7ff710067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 0x7ff710067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff720007fd0 tx=0x7ff720007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 msgr2=0x7ff730155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00d890 tx=0x7ff71c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 shutdown_connections 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ff710065150 0x7ff710067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff73006ddb0 0x7ff730155ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff730155250 0x7ff730157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 --2- 172.21.15.146:0/3086884619 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff73006d9e0 0x7ff73014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 >> 172.21.15.146:0/3086884619 conn(0x7ff730067750 msgr2=0x7ff73006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 shutdown_connections 2024-08-17T02:29:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.519+0000 7ff736a00640 1 -- 172.21.15.146:0/3086884619 wait complete. 2024-08-17T02:29:16.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039307.meta pg_num 2024-08-17T02:29:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.686+0000 7fbb48800640 1 Processor -- start 2024-08-17T02:29:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.686+0000 7fbb48800640 1 -- start start 2024-08-17T02:29:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb48800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb40156c50 0x7fbb400c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb48800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb400c8bd0 0x7fbb400c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb48800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb400c9570 con 0x7fbb400adcf0 2024-08-17T02:29:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb48800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb400ab130 con 0x7fbb40156c50 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb48800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400ae5a0 con 0x7fbb400c8bd0 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb40156c50 0x7fbb400c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb40156c50 0x7fbb400c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37418/0 (socket says 172.21.15.146:37418) 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 -- 172.21.15.146:0/3820478857 learned_addr learned my addr 172.21.15.146:0/3820478857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb46800640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb400c8bd0 0x7fbb400c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 -- 172.21.15.146:0/3820478857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb400c8bd0 msgr2=0x7fbb400c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb400c8bd0 0x7fbb400c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 -- 172.21.15.146:0/3820478857 >> v1:172.21.15.150:6789/0 conn(0x7fbb400adcf0 legacy=0x7fbb400ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.688+0000 7fbb45e00640 1 -- 172.21.15.146:0/3820478857 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb400ae2c0 con 0x7fbb40156c50 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.689+0000 7fbb45e00640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb40156c50 0x7fbb400c7cf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009910 tx=0x7fbb340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d273f0d929c61216 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb44a00640 1 -- 172.21.15.146:0/3820478857 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3402ad20 con 0x7fbb40156c50 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb44a00640 1 -- 172.21.15.146:0/3820478857 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3402ae80 con 0x7fbb40156c50 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb44a00640 1 -- 172.21.15.146:0/3820478857 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34032670 con 0x7fbb40156c50 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 -- 172.21.15.146:0/3820478857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb40156c50 msgr2=0x7fbb400c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb40156c50 0x7fbb400c7cf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009910 tx=0x7fbb340091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 -- 172.21.15.146:0/3820478857 shutdown_connections 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb400c8bd0 0x7fbb400c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 --2- 172.21.15.146:0/3820478857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb40156c50 0x7fbb400c7cf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 -- 172.21.15.146:0/3820478857 >> 172.21.15.146:0/3820478857 conn(0x7fbb40067750 msgr2=0x7fbb400c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 -- 172.21.15.146:0/3820478857 shutdown_connections 2024-08-17T02:29:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.690+0000 7fbb48800640 1 -- 172.21.15.146:0/3820478857 wait complete. 2024-08-17T02:29:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.692+0000 7fbb48800640 1 Processor -- start 2024-08-17T02:29:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.692+0000 7fbb48800640 1 -- start start 2024-08-17T02:29:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb400adcf0 0x7fbb4013cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb40156c50 0x7fbb4014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb401591d0 con 0x7fbb400c8bd0 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40157020 con 0x7fbb400adcf0 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb48800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40157300 con 0x7fbb40156c50 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37430/0 (socket says 172.21.15.146:37430) 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45400640 1 -- 172.21.15.146:0/893313063 learned_addr learned my addr 172.21.15.146:0/893313063 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb46800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb40156c50 0x7fbb4014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45e00640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb400adcf0 0x7fbb4013cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45400640 1 -- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb40156c50 msgr2=0x7fbb4014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.693+0000 7fbb45400640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb40156c50 0x7fbb4014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb45400640 1 -- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb400adcf0 msgr2=0x7fbb4013cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb45400640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb400adcf0 0x7fbb4013cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb45400640 1 -- 172.21.15.146:0/893313063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb34009450 con 0x7fbb400c8bd0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb45400640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c590 tx=0x7fbb30007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30012630 con 0x7fbb400c8bd0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb300127b0 con 0x7fbb400c8bd0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30012b70 con 0x7fbb400c8bd0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4014ce00 con 0x7fbb400c8bd0 2024-08-17T02:29:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.694+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40159700 con 0x7fbb400c8bd0 2024-08-17T02:29:16.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.695+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40157470 con 0x7fbb400c8bd0 2024-08-17T02:29:16.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.696+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb3001b400 con 0x7fbb400c8bd0 2024-08-17T02:29:16.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.697+0000 7fbb39600640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 0x7fbb24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:16.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.697+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbb30081d40 con 0x7fbb400c8bd0 2024-08-17T02:29:16.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.697+0000 7fbb45e00640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 0x7fbb24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:16.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.698+0000 7fbb45e00640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 0x7fbb24067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb34034000 tx=0x7fbb34032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.701+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb3004fd90 con 0x7fbb400c8bd0 2024-08-17T02:29:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.876+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.meta", "var": "pg_num"} v 0) v1 -- 0x7fbb400c9570 con 0x7fbb400c8bd0 2024-08-17T02:29:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.877+0000 7fbb39600640 1 -- 172.21.15.146:0/893313063 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7fbb400c9570 con 0x7fbb400c8bd0 2024-08-17T02:29:16.877 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:29:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 msgr2=0x7fbb24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 0x7fbb24067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb34034000 tx=0x7fbb34032000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 msgr2=0x7fbb4014c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000c590 tx=0x7fbb30007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 shutdown_connections 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbb24065150 0x7fbb24067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb400c8bd0 0x7fbb4014c8c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb40156c50 0x7fbb4014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 --2- 172.21.15.146:0/893313063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb400adcf0 0x7fbb4013cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 >> 172.21.15.146:0/893313063 conn(0x7fbb40067750 msgr2=0x7fbb4006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 shutdown_connections 2024-08-17T02:29:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:16.879+0000 7fbb48800640 1 -- 172.21.15.146:0/893313063 wait complete. 2024-08-17T02:29:16.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039307.data pg_num 2024-08-17T02:29:17.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.047+0000 7f277e800640 1 Processor -- start 2024-08-17T02:29:17.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.047+0000 7f277e800640 1 -- start start 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f277e800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2778155a80 0x7f277806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f277e800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27780c7db0 0x7f27780c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f277e800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27781598f0 con 0x7f2778155e50 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f277e800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778159bd0 con 0x7f27780c7db0 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f277e800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778159eb0 con 0x7f2778155a80 2024-08-17T02:29:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.048+0000 7f2776a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27780c7db0 0x7f27780c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27780c7db0 0x7f27780c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37438/0 (socket says 172.21.15.146:37438) 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 -- 172.21.15.146:0/1975373825 learned_addr learned my addr 172.21.15.146:0/1975373825 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2777e00640 1 --1- 172.21.15.146:0/1975373825 >> v1:172.21.15.146:6789/0 conn(0x7f2778155e50 0x7f277806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44380/0 (socket says 172.21.15.146:44380) 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2777400640 1 --2- 172.21.15.146:0/1975373825 >> v2:172.21.15.150:3300/0 conn(0x7f2778155a80 0x7f277806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 -- 172.21.15.146:0/1975373825 >> v2:172.21.15.150:3300/0 conn(0x7f2778155a80 msgr2=0x7f277806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 --2- 172.21.15.146:0/1975373825 >> v2:172.21.15.150:3300/0 conn(0x7f2778155a80 0x7f277806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 -- 172.21.15.146:0/1975373825 >> v1:172.21.15.146:6789/0 conn(0x7f2778155e50 legacy=0x7f277806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.049+0000 7f2776a00640 1 -- 172.21.15.146:0/1975373825 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277815a190 con 0x7f27780c7db0 2024-08-17T02:29:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.050+0000 7f2776a00640 1 --2- 172.21.15.146:0/1975373825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27780c7db0 0x7f27780c8bd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f277806efd0 tx=0x7f27640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1377b22060c07484 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.050+0000 7f2776000640 1 -- 172.21.15.146:0/1975373825 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764032440 con 0x7f27780c7db0 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.050+0000 7f2776000640 1 -- 172.21.15.146:0/1975373825 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27640325a0 con 0x7f27780c7db0 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.050+0000 7f2776000640 1 -- 172.21.15.146:0/1975373825 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764032980 con 0x7f27780c7db0 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 -- 172.21.15.146:0/1975373825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27780c7db0 msgr2=0x7f27780c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 --2- 172.21.15.146:0/1975373825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27780c7db0 0x7f27780c8bd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f277806efd0 tx=0x7f27640091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 -- 172.21.15.146:0/1975373825 shutdown_connections 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 --2- 172.21.15.146:0/1975373825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27780c7db0 0x7f27780c8bd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 --2- 172.21.15.146:0/1975373825 >> v2:172.21.15.150:3300/0 conn(0x7f2778155a80 0x7f277806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 -- 172.21.15.146:0/1975373825 >> 172.21.15.146:0/1975373825 conn(0x7f2778067750 msgr2=0x7f27780c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 -- 172.21.15.146:0/1975373825 shutdown_connections 2024-08-17T02:29:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.051+0000 7f277e800640 1 -- 172.21.15.146:0/1975373825 wait complete. 2024-08-17T02:29:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.052+0000 7f277e800640 1 Processor -- start 2024-08-17T02:29:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.052+0000 7f277e800640 1 -- start start 2024-08-17T02:29:17.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27780c7db0 0x7f277814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778155a80 0x7f2778147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277814ea20 con 0x7f2778155e50 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780ad1b0 con 0x7f2778155a80 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.053+0000 7f277e800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780ad640 con 0x7f27780c7db0 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37440/0 (socket says 172.21.15.146:37440) 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 -- 172.21.15.146:0/393207779 learned_addr learned my addr 172.21.15.146:0/393207779 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27780c7db0 0x7f277814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2776a00640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778155a80 0x7f2778147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 -- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27780c7db0 msgr2=0x7f277814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27780c7db0 0x7f277814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 -- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778155a80 msgr2=0x7f2778147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778155a80 0x7f2778147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 -- 172.21.15.146:0/393207779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009450 con 0x7f2778155e50 2024-08-17T02:29:17.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.054+0000 7f2777e00640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f277000c840 tx=0x7f27700015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.055+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000ce30 con 0x7f2778155e50 2024-08-17T02:29:17.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.055+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770005d60 con 0x7f2778155e50 2024-08-17T02:29:17.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.055+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000a830 con 0x7f2778155e50 2024-08-17T02:29:17.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.055+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780ac5a0 con 0x7f2778155e50 2024-08-17T02:29:17.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.055+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780ace40 con 0x7f2778155e50 2024-08-17T02:29:17.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.056+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27780ac9a0 con 0x7f2778155e50 2024-08-17T02:29:17.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.057+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f277000ac60 con 0x7f2778155e50 2024-08-17T02:29:17.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.057+0000 7f276ea00640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 0x7f2758067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.058+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2770081f50 con 0x7f2778155e50 2024-08-17T02:29:17.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.058+0000 7f2777400640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 0x7f2758067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.058+0000 7f2777400640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 0x7f2758067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f277815b8c0 tx=0x7f2768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.061+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f27700500c0 con 0x7f2778155e50 2024-08-17T02:29:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.233+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.data", "var": "pg_num"} v 0) v1 -- 0x7f27780ad320 con 0x7f2778155e50 2024-08-17T02:29:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.233+0000 7f276ea00640 1 -- 172.21.15.146:0/393207779 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039307.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f27700536e0 con 0x7f2778155e50 2024-08-17T02:29:17.233 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 msgr2=0x7f2758067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 0x7f2758067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f277815b8c0 tx=0x7f2768008040 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 msgr2=0x7f27780c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f277000c840 tx=0x7f27700015f0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 shutdown_connections 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2758065150 0x7f2758067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778155e50 0x7f27780c8630 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2778155a80 0x7f2778147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 --2- 172.21.15.146:0/393207779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f27780c7db0 0x7f277814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.235+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 >> 172.21.15.146:0/393207779 conn(0x7f2778067750 msgr2=0x7f277806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.236+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 shutdown_connections 2024-08-17T02:29:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.236+0000 7f277e800640 1 -- 172.21.15.146:0/393207779 wait complete. 2024-08-17T02:29:17.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:17.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.402+0000 7f8c06400640 1 Processor -- start 2024-08-17T02:29:17.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.402+0000 7f8c06400640 1 -- start start 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.403+0000 7f8c06400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c001401b0 0x7f8c000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.403+0000 7f8c06400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8c00140580 0x7f8c000b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.403+0000 7f8c06400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000b16d0 con 0x7f8c000b1270 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8c06400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000cb450 con 0x7f8c001401b0 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8c06400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000caa80 con 0x7f8c00140580 2024-08-17T02:29:17.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bff400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c001401b0 0x7f8c000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bffe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8c000b1270 0x7f8c000c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44392/0 (socket says 172.21.15.146:44392) 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bffe00640 1 -- 172.21.15.146:0/1476138935 learned_addr learned my addr 172.21.15.146:0/1476138935 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bff400640 1 -- 172.21.15.146:0/1476138935 >> v2:172.21.15.150:3300/0 conn(0x7f8c00140580 msgr2=0x7f8c000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bff400640 1 --2- 172.21.15.146:0/1476138935 >> v2:172.21.15.150:3300/0 conn(0x7f8c00140580 0x7f8c000b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bff400640 1 -- 172.21.15.146:0/1476138935 >> v1:172.21.15.146:6789/0 conn(0x7f8c000b1270 legacy=0x7f8c000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.404+0000 7f8bff400640 1 -- 172.21.15.146:0/1476138935 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000c9e70 con 0x7f8c001401b0 2024-08-17T02:29:17.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.405+0000 7f8bff400640 1 --2- 172.21.15.146:0/1476138935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000caf10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006aa80 tx=0x7f8bf00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1264c8ade3d360d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.405+0000 7f8bfea00640 1 -- 172.21.15.146:0/1476138935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf002ad20 con 0x7f8c001401b0 2024-08-17T02:29:17.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8bfea00640 1 -- 172.21.15.146:0/1476138935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf002ae80 con 0x7f8c001401b0 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8bfea00640 1 -- 172.21.15.146:0/1476138935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0032670 con 0x7f8c001401b0 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 -- 172.21.15.146:0/1476138935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 msgr2=0x7f8c000caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 --2- 172.21.15.146:0/1476138935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000caf10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006aa80 tx=0x7f8bf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 -- 172.21.15.146:0/1476138935 shutdown_connections 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 --2- 172.21.15.146:0/1476138935 >> v2:172.21.15.150:3300/0 conn(0x7f8c00140580 0x7f8c000b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 --2- 172.21.15.146:0/1476138935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000caf10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 -- 172.21.15.146:0/1476138935 >> 172.21.15.146:0/1476138935 conn(0x7f8c000cb9b0 msgr2=0x7f8c000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 -- 172.21.15.146:0/1476138935 shutdown_connections 2024-08-17T02:29:17.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.406+0000 7f8c06400640 1 -- 172.21.15.146:0/1476138935 wait complete. 2024-08-17T02:29:17.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.408+0000 7f8c06400640 1 Processor -- start 2024-08-17T02:29:17.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.408+0000 7f8c06400640 1 -- start start 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c000b1270 0x7f8c000a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 0x7f8c00156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000a9980 con 0x7f8c001401b0 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000ac320 con 0x7f8c00140580 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8c06400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000a6ac0 con 0x7f8c000b1270 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37472/0 (socket says 172.21.15.146:37472) 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 -- 172.21.15.146:0/796624438 learned_addr learned my addr 172.21.15.146:0/796624438 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:17.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bff400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c000b1270 0x7f8c000a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bffe00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 0x7f8c00156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 -- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c000b1270 msgr2=0x7f8c000a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c000b1270 0x7f8c000a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 -- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 msgr2=0x7f8c00156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 0x7f8c00156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bf7e00640 1 -- 172.21.15.146:0/796624438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009390 con 0x7f8c001401b0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.409+0000 7f8bffe00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 0x7f8c00156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8bf7e00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8be800b810 tx=0x7f8be80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800be60 con 0x7f8c001401b0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800c730 con 0x7f8c001401b0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800caf0 con 0x7f8c001401b0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c000abd70 con 0x7f8c001401b0 2024-08-17T02:29:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.410+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c000a6750 con 0x7f8c001401b0 2024-08-17T02:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.411+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00064db0 con 0x7f8c001401b0 2024-08-17T02:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.412+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8be8012070 con 0x7f8c001401b0 2024-08-17T02:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.413+0000 7f8bf6a00640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 0x7f8bdc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.413+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8be8081b90 con 0x7f8c001401b0 2024-08-17T02:29:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.413+0000 7f8bff400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 0x7f8bdc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.414+0000 7f8bff400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 0x7f8bdc067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0034000 tx=0x7f8bf0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.416+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8be804fbd0 con 0x7f8c001401b0 2024-08-17T02:29:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.628+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c000a6c00 con 0x7f8c001401b0 2024-08-17T02:29:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.628+0000 7f8bf6a00640 1 -- 172.21.15.146:0/796624438 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f8be80531f0 con 0x7f8c001401b0 2024-08-17T02:29:17.629 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:17.629 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/142672190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":142672190},{"type":"v1","addr":"172.21.15.146:6835","nonce":142672190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 23 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 msgr2=0x7f8bdc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 0x7f8bdc067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0034000 tx=0x7f8bf0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 msgr2=0x7f8c000ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8be800b810 tx=0x7f8be80091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 shutdown_connections 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f8bdc065150 0x7f8bdc067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c001401b0 0x7f8c000ab830 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c00140580 0x7f8c00156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 --2- 172.21.15.146:0/796624438 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8c000b1270 0x7f8c000a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.630+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 >> 172.21.15.146:0/796624438 conn(0x7f8c000cb9b0 msgr2=0x7f8c0006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.631+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 shutdown_connections 2024-08-17T02:29:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.631+0000 7f8c06400640 1 -- 172.21.15.146:0/796624438 wait complete. 2024-08-17T02:29:17.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.794+0000 7fe534400640 1 Processor -- start 2024-08-17T02:29:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.794+0000 7fe534400640 1 -- start start 2024-08-17T02:29:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe534400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 0x7fe52c157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe534400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe52c157b60 0x7fe52c0abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe534400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c158e60 con 0x7fe52c0ac080 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe534400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c158530 con 0x7fe52c157b60 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe534400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c158810 con 0x7fe52c157250 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.795+0000 7fe531000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe52c157b60 0x7fe52c0abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe52c157b60 0x7fe52c0abb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37482/0 (socket says 172.21.15.146:37482) 2024-08-17T02:29:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 -- 172.21.15.146:0/3691194572 learned_addr learned my addr 172.21.15.146:0/3691194572 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531a00640 1 --2- 172.21.15.146:0/3691194572 >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 0x7fe52c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 -- 172.21.15.146:0/3691194572 >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 msgr2=0x7fe52c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 --2- 172.21.15.146:0/3691194572 >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 0x7fe52c157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 -- 172.21.15.146:0/3691194572 >> v1:172.21.15.150:6789/0 conn(0x7fe52c0ac080 legacy=0x7fe52c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531000640 1 -- 172.21.15.146:0/3691194572 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c158af0 con 0x7fe52c157b60 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.796+0000 7fe531a00640 1 --2- 172.21.15.146:0/3691194572 >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 0x7fe52c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.797+0000 7fe531000640 1 --2- 172.21.15.146:0/3691194572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c0abb40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe52c070900 tx=0x7fe5180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ab93440428329 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.798+0000 7fe52be00640 1 -- 172.21.15.146:0/3691194572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51802add0 con 0x7fe52c157b60 2024-08-17T02:29:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.798+0000 7fe52be00640 1 -- 172.21.15.146:0/3691194572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518032440 con 0x7fe52c157b60 2024-08-17T02:29:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.798+0000 7fe52be00640 1 -- 172.21.15.146:0/3691194572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518032820 con 0x7fe52c157b60 2024-08-17T02:29:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.798+0000 7fe534400640 1 -- 172.21.15.146:0/3691194572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 msgr2=0x7fe52c0abb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.798+0000 7fe534400640 1 --2- 172.21.15.146:0/3691194572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c0abb40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe52c070900 tx=0x7fe5180091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 -- 172.21.15.146:0/3691194572 shutdown_connections 2024-08-17T02:29:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 --2- 172.21.15.146:0/3691194572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c0abb40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 --2- 172.21.15.146:0/3691194572 >> v2:172.21.15.150:3300/0 conn(0x7fe52c157250 0x7fe52c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 -- 172.21.15.146:0/3691194572 >> 172.21.15.146:0/3691194572 conn(0x7fe52c096a70 msgr2=0x7fe52c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 -- 172.21.15.146:0/3691194572 shutdown_connections 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.799+0000 7fe534400640 1 -- 172.21.15.146:0/3691194572 wait complete. 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.800+0000 7fe534400640 1 Processor -- start 2024-08-17T02:29:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.800+0000 7fe534400640 1 -- start start 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c0ac080 0x7fe52c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52c157250 0x7fe52c0b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b1170 con 0x7fe52c157b60 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c097a10 con 0x7fe52c0ac080 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe534400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b13a0 con 0x7fe52c157250 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe532400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe532400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37484/0 (socket says 172.21.15.146:37484) 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe532400640 1 -- 172.21.15.146:0/1227030325 learned_addr learned my addr 172.21.15.146:0/1227030325 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe531000640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52c157250 0x7fe52c0b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.801+0000 7fe531a00640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c0ac080 0x7fe52c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 -- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52c157250 msgr2=0x7fe52c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52c157250 0x7fe52c0b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 -- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c0ac080 msgr2=0x7fe52c0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c0ac080 0x7fe52c0b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 -- 172.21.15.146:0/1227030325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009450 con 0x7fe52c157b60 2024-08-17T02:29:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe532400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe52400c890 tx=0x7fe524002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52400ce80 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52400a7f0 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52400abf0 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0b1680 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.802+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0b1c40 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.803+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c097ba0 con 0x7fe52c157b60 2024-08-17T02:29:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.804+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe52400ad50 con 0x7fe52c157b60 2024-08-17T02:29:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.805+0000 7fe528c00640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.805+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fe524082770 con 0x7fe52c157b60 2024-08-17T02:29:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.806+0000 7fe531a00640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.806+0000 7fe531a00640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 0x7fe50c067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe52000acc0 tx=0x7fe520008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.810+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5240507c0 con 0x7fe52c157b60 2024-08-17T02:29:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.983+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe52c064db0 con 0x7fe52c157b60 2024-08-17T02:29:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.984+0000 7fe528c00640 1 -- 172.21.15.146:0/1227030325 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fe524053de0 con 0x7fe52c157b60 2024-08-17T02:29:17.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:17.985 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:29:15.777789+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/4020030705":"2024-08-18T02:29:12.767829+0000","172.21.15.146:6834/4020030705":"2024-08-18T02:29:12.767829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.986+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 msgr2=0x7fe50c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.986+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 0x7fe50c067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe52000acc0 tx=0x7fe520008040 comp rx=0 tx=0).stop 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 msgr2=0x7fe52c14f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe52400c890 tx=0x7fe524002640 comp rx=0 tx=0).stop 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 shutdown_connections 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe52c157b60 0x7fe52c14f6e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe52c157250 0x7fe52c0b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 --2- 172.21.15.146:0/1227030325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe52c0ac080 0x7fe52c0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 >> 172.21.15.146:0/1227030325 conn(0x7fe52c096a70 msgr2=0x7fe52c153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 shutdown_connections 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:17.987+0000 7fe534400640 1 -- 172.21.15.146:0/1227030325 wait complete. 2024-08-17T02:29:18.003 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001039307 and related pools 2024-08-17T02:29:18.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:18.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.154+0000 7fd283000640 1 Processor -- start 2024-08-17T02:29:18.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.154+0000 7fd283000640 1 -- start start 2024-08-17T02:29:18.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.155+0000 7fd283000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd27c06da20 0x7fd27c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.155+0000 7fd283000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c158fa0 0x7fd27c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.155+0000 7fd283000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c0a9a10 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.155+0000 7fd283000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0ac400 con 0x7fd27c06da20 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.155+0000 7fd283000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0a9cf0 con 0x7fd27c158fa0 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd27c06da20 0x7fd27c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd27c06da20 0x7fd27c06ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37486/0 (socket says 172.21.15.146:37486) 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27b400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd27c0aa7d0 0x7fd27c158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44396/0 (socket says 172.21.15.146:44396) 2024-08-17T02:29:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 -- 172.21.15.146:0/2494803482 learned_addr learned my addr 172.21.15.146:0/2494803482 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:18.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd281000640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c158fa0 0x7fd27c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 -- 172.21.15.146:0/2494803482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c158fa0 msgr2=0x7fd27c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c158fa0 0x7fd27c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 -- 172.21.15.146:0/2494803482 >> v1:172.21.15.146:6789/0 conn(0x7fd27c0aa7d0 legacy=0x7fd27c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27be00640 1 -- 172.21.15.146:0/2494803482 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0a9fd0 con 0x7fd27c06da20 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.156+0000 7fd27aa00640 1 -- 172.21.15.146:0/2494803482 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656758195 0 0) 0x7fd27c0a9a10 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.157+0000 7fd27be00640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c06da20 0x7fd27c06ddf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009910 tx=0x7fd26c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f6432ccbc8a2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.157+0000 7fd27aa00640 1 -- 172.21.15.146:0/2494803482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c02adb0 con 0x7fd27c06da20 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.157+0000 7fd27aa00640 1 -- 172.21.15.146:0/2494803482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c032440 con 0x7fd27c06da20 2024-08-17T02:29:18.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.157+0000 7fd27aa00640 1 -- 172.21.15.146:0/2494803482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0327e0 con 0x7fd27c06da20 2024-08-17T02:29:18.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 -- 172.21.15.146:0/2494803482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c06da20 msgr2=0x7fd27c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c06da20 0x7fd27c06ddf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009910 tx=0x7fd26c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 -- 172.21.15.146:0/2494803482 shutdown_connections 2024-08-17T02:29:18.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c158fa0 0x7fd27c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 --2- 172.21.15.146:0/2494803482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c06da20 0x7fd27c06ddf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 -- 172.21.15.146:0/2494803482 >> 172.21.15.146:0/2494803482 conn(0x7fd27c0cb9b0 msgr2=0x7fd27c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 -- 172.21.15.146:0/2494803482 shutdown_connections 2024-08-17T02:29:18.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.158+0000 7fd283000640 1 -- 172.21.15.146:0/2494803482 wait complete. 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.159+0000 7fd283000640 1 Processor -- start 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.160+0000 7fd283000640 1 -- start start 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.160+0000 7fd283000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.160+0000 7fd283000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd27c158fa0 0x7fd27c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd283000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c0ca0a0 0x7fd27c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd283000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c16d5f0 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd283000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15d480 con 0x7fd27c158fa0 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd283000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c15d760 con 0x7fd27c0ca0a0 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37490/0 (socket says 172.21.15.146:37490) 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 -- 172.21.15.146:0/2991656742 learned_addr learned my addr 172.21.15.146:0/2991656742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 -- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c0ca0a0 msgr2=0x7fd27c1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c0ca0a0 0x7fd27c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 -- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd27c158fa0 msgr2=0x7fd27c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd27c158fa0 0x7fd27c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 -- 172.21.15.146:0/2991656742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009450 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.161+0000 7fd27be00640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd26c02a730 tx=0x7fd26c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.162+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c000cf0 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.162+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c031de0 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.162+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c03d690 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.162+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c15da40 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.162+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c15e000 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.163+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c159440 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.164+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd26c039040 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.165+0000 7fd273400640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 0x7fd25c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.165+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd26c0a2290 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.165+0000 7fd27b400640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 0x7fd25c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.165+0000 7fd27b400640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 0x7fd25c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2680011e0 tx=0x7fd268007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.169+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd27c159440 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.378+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd27c159440 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.379+0000 7fd273400640 1 -- 172.21.15.146:0/2991656742 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7fd26c0702d0 con 0x7fd27c0aa7d0 2024-08-17T02:29:18.379 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/142672190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":142672190},{"type":"v1","addr":"172.21.15.146:6835","nonce":142672190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:18.380 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 23 2024-08-17T02:29:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 msgr2=0x7fd25c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 0x7fd25c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2680011e0 tx=0x7fd268007920 comp rx=0 tx=0).stop 2024-08-17T02:29:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 msgr2=0x7fd27c16d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd26c02a730 tx=0x7fd26c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 shutdown_connections 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd25c065150 0x7fd25c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd27c0ca0a0 0x7fd27c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd27c158fa0 0x7fd27c0c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 --2- 172.21.15.146:0/2991656742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd27c0aa7d0 0x7fd27c16d0b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 >> 172.21.15.146:0/2991656742 conn(0x7fd27c0cb9b0 msgr2=0x7fd27c158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 shutdown_connections 2024-08-17T02:29:18.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.381+0000 7fd283000640 1 -- 172.21.15.146:0/2991656742 wait complete. 2024-08-17T02:29:18.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.544+0000 7fda2be00640 1 Processor -- start 2024-08-17T02:29:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.544+0000 7fda2be00640 1 -- start start 2024-08-17T02:29:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2be00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda2c0ccad0 0x7fda2c162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2be00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0cadc0 con 0x7fda2c159ca0 2024-08-17T02:29:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2be00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0cd6e0 con 0x7fda2c0ccad0 2024-08-17T02:29:18.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0ccf70 con 0x7fda2c0ceb40 2024-08-17T02:29:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.545+0000 7fda2a000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2b400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda2c0ccad0 0x7fda2c162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2aa00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fda2c159ca0 0x7fda2c0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:40988/0 (socket says 172.21.15.146:40988) 2024-08-17T02:29:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2aa00640 1 -- 172.21.15.146:0/1069973837 learned_addr learned my addr 172.21.15.146:0/1069973837 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2a000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.146:57616/0 (socket says 172.21.15.146:57616) 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2a000640 1 -- 172.21.15.146:0/1069973837 >> v2:172.21.15.150:3300/0 conn(0x7fda2c0ccad0 msgr2=0x7fda2c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2a000640 1 --2- 172.21.15.146:0/1069973837 >> v2:172.21.15.150:3300/0 conn(0x7fda2c0ccad0 0x7fda2c162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2a000640 1 -- 172.21.15.146:0/1069973837 >> v1:172.21.15.150:6789/0 conn(0x7fda2c159ca0 legacy=0x7fda2c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda2a000640 1 -- 172.21.15.146:0/1069973837 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0cb060 con 0x7fda2c0ceb40 2024-08-17T02:29:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.546+0000 7fda29600640 1 -- 172.21.15.146:0/1069973837 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997845476 0 0) 0x7fda2c0cadc0 con 0x7fda2c159ca0 2024-08-17T02:29:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.547+0000 7fda2a000640 1 --2- 172.21.15.146:0/1069973837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda18009850 tx=0x7fda180090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f06ef5be4b6420 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda29600640 1 -- 172.21.15.146:0/1069973837 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1802ad90 con 0x7fda2c0ceb40 2024-08-17T02:29:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda29600640 1 -- 172.21.15.146:0/1069973837 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18032440 con 0x7fda2c0ceb40 2024-08-17T02:29:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda29600640 1 -- 172.21.15.146:0/1069973837 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180327e0 con 0x7fda2c0ceb40 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 -- 172.21.15.146:0/1069973837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 msgr2=0x7fda2c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 --2- 172.21.15.146:0/1069973837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda18009850 tx=0x7fda180090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 -- 172.21.15.146:0/1069973837 shutdown_connections 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 --2- 172.21.15.146:0/1069973837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ceb40 0x7fda2c0cc590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 --2- 172.21.15.146:0/1069973837 >> v2:172.21.15.150:3300/0 conn(0x7fda2c0ccad0 0x7fda2c162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.548+0000 7fda2be00640 1 -- 172.21.15.146:0/1069973837 >> 172.21.15.146:0/1069973837 conn(0x7fda2c098e00 msgr2=0x7fda2c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.549+0000 7fda2be00640 1 -- 172.21.15.146:0/1069973837 shutdown_connections 2024-08-17T02:29:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.549+0000 7fda2be00640 1 -- 172.21.15.146:0/1069973837 wait complete. 2024-08-17T02:29:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.550+0000 7fda2be00640 1 Processor -- start 2024-08-17T02:29:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.550+0000 7fda2be00640 1 -- start start 2024-08-17T02:29:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ccad0 0x7fda2c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 0x7fda2c0c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c1498d0 con 0x7fda2c0ceb40 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c75f0 con 0x7fda2c159ca0 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2be00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c59b0 con 0x7fda2c0ccad0 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37492/0 (socket says 172.21.15.146:37492) 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2a000640 1 -- 172.21.15.146:0/2246682512 learned_addr learned my addr 172.21.15.146:0/2246682512 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2aa00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ccad0 0x7fda2c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.551+0000 7fda2b400640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 0x7fda2c0c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 -- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ccad0 msgr2=0x7fda2c0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ccad0 0x7fda2c0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 -- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 msgr2=0x7fda2c0c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 0x7fda2c0c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 -- 172.21.15.146:0/2246682512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda18009390 con 0x7fda2c0ceb40 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2b400640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 0x7fda2c0c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2a000640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fda18009360 tx=0x7fda18032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18000d10 con 0x7fda2c0ceb40 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18031e00 con 0x7fda2c0ceb40 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1803d670 con 0x7fda2c0ceb40 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.552+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c0c5c90 con 0x7fda2c0ceb40 2024-08-17T02:29:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.553+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c0c6ce0 con 0x7fda2c0ceb40 2024-08-17T02:29:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.554+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c0c6190 con 0x7fda2c0ceb40 2024-08-17T02:29:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.554+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda18039040 con 0x7fda2c0ceb40 2024-08-17T02:29:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.555+0000 7fda22000640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 0x7fda0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.555+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fda180a2430 con 0x7fda2c0ceb40 2024-08-17T02:29:18.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.555+0000 7fda2aa00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 0x7fda0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.556+0000 7fda2aa00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 0x7fda0c067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda1c007160 tx=0x7fda1c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.559+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fda18070500 con 0x7fda2c0ceb40 2024-08-17T02:29:18.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.769+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda2c0c6ed0 con 0x7fda2c0ceb40 2024-08-17T02:29:18.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.769+0000 7fda22000640 1 -- 172.21.15.146:0/2246682512 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7fda18073b20 con 0x7fda2c0ceb40 2024-08-17T02:29:18.770 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:18.770 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/142672190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":142672190},{"type":"v1","addr":"172.21.15.146:6835","nonce":142672190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:05.343749+0000","modified":"2024-08-17T02:27:07.353516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4930":{"gid":4930,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.150:6835/414928528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":414928528},{"type":"v1","addr":"172.21.15.150:6835","nonce":414928528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039307","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:29:18.770 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 23 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.771+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 msgr2=0x7fda0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 0x7fda0c067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda1c007160 tx=0x7fda1c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 msgr2=0x7fda2c0c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fda18009360 tx=0x7fda18032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 shutdown_connections 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fda0c065150 0x7fda0c067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2c0ceb40 0x7fda2c0c9960 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda2c159ca0 0x7fda2c0c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 --2- 172.21.15.146:0/2246682512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda2c0ccad0 0x7fda2c0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 >> 172.21.15.146:0/2246682512 conn(0x7fda2c098e00 msgr2=0x7fda2c159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 shutdown_connections 2024-08-17T02:29:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.772+0000 7fda2be00640 1 -- 172.21.15.146:0/2246682512 wait complete. 2024-08-17T02:29:18.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:18.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.936+0000 7f14b7200640 1 Processor -- start 2024-08-17T02:29:18.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.937+0000 7f14b7200640 1 -- start start 2024-08-17T02:29:18.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b7200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f14b80ada20 0x7f14b80c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b7200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14b8159c40 0x7f14b80addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b7200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80ae6b0 con 0x7f14b80cae60 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b7200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80cc5b0 con 0x7f14b8159c40 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b7200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b80af230 con 0x7f14b80ada20 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14afe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14b8159c40 0x7f14b80addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14afe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14b8159c40 0x7f14b80addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37500/0 (socket says 172.21.15.146:37500) 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14afe00640 1 -- 172.21.15.146:0/1422438829 learned_addr learned my addr 172.21.15.146:0/1422438829 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b6800640 1 --1- 172.21.15.146:0/1422438829 >> v1:172.21.15.146:6789/0 conn(0x7f14b80cae60 0x7f14b80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44404/0 (socket says 172.21.15.146:44404) 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.938+0000 7f14b5e00640 1 --2- 172.21.15.146:0/1422438829 >> v2:172.21.15.150:3300/0 conn(0x7f14b80ada20 0x7f14b80c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14b5400640 1 -- 172.21.15.146:0/1422438829 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262982718 0 0) 0x7f14b80ae6b0 con 0x7f14b80cae60 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14b5400640 1 -- 172.21.15.146:0/1422438829 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c0034e0 con 0x7f14b80cae60 2024-08-17T02:29:18.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14afe00640 1 -- 172.21.15.146:0/1422438829 >> v2:172.21.15.150:3300/0 conn(0x7f14b80ada20 msgr2=0x7f14b80c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14afe00640 1 --2- 172.21.15.146:0/1422438829 >> v2:172.21.15.150:3300/0 conn(0x7f14b80ada20 0x7f14b80c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14afe00640 1 -- 172.21.15.146:0/1422438829 >> v1:172.21.15.146:6789/0 conn(0x7f14b80cae60 legacy=0x7f14b80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.939+0000 7f14afe00640 1 -- 172.21.15.146:0/1422438829 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80ae900 con 0x7f14b8159c40 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14afe00640 1 --2- 172.21.15.146:0/1422438829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b80addf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14b8065fd0 tx=0x7f14a000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9353063a1231dd6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14b5400640 1 -- 172.21.15.146:0/1422438829 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0031650 con 0x7f14b8159c40 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14b5400640 1 -- 172.21.15.146:0/1422438829 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a00317b0 con 0x7f14b8159c40 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14b5400640 1 -- 172.21.15.146:0/1422438829 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0031b70 con 0x7f14b8159c40 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14b7200640 1 -- 172.21.15.146:0/1422438829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 msgr2=0x7f14b80addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.940+0000 7f14b7200640 1 --2- 172.21.15.146:0/1422438829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b80addf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f14b8065fd0 tx=0x7f14a000b460 comp rx=0 tx=0).stop 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 -- 172.21.15.146:0/1422438829 shutdown_connections 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 --2- 172.21.15.146:0/1422438829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b80addf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 --2- 172.21.15.146:0/1422438829 >> v2:172.21.15.150:3300/0 conn(0x7f14b80ada20 0x7f14b80c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 -- 172.21.15.146:0/1422438829 >> 172.21.15.146:0/1422438829 conn(0x7f14b8067750 msgr2=0x7f14b80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 -- 172.21.15.146:0/1422438829 shutdown_connections 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.941+0000 7f14b7200640 1 -- 172.21.15.146:0/1422438829 wait complete. 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.942+0000 7f14b7200640 1 Processor -- start 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.942+0000 7f14b7200640 1 -- start start 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b80ada20 0x7f14b8158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b80cae60 0x7f14b80aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80ab170 con 0x7f14b8159c40 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8157090 con 0x7f14b80ada20 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b7200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8157370 con 0x7f14b80cae60 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b6800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37512/0 (socket says 172.21.15.146:37512) 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b6800640 1 -- 172.21.15.146:0/907214800 learned_addr learned my addr 172.21.15.146:0/907214800 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14b5e00640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b80ada20 0x7f14b8158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.943+0000 7f14afe00640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b80cae60 0x7f14b80aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 -- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b80cae60 msgr2=0x7f14b80aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b80cae60 0x7f14b80aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 -- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b80ada20 msgr2=0x7f14b8158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b80ada20 0x7f14b8158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 -- 172.21.15.146:0/907214800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a000b700 con 0x7f14b8159c40 2024-08-17T02:29:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b6800640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c910 tx=0x7f14b00016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0005d60 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000a5e0 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000a9a0 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8157650 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.944+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8157c10 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.945+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b8157e00 con 0x7f14b8159c40 2024-08-17T02:29:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.946+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14b00070f0 con 0x7f14b8159c40 2024-08-17T02:29:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.947+0000 7f14ad600640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 0x7f1494067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.947+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f14b0082280 con 0x7f14b8159c40 2024-08-17T02:29:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.947+0000 7f14b5e00640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 0x7f1494067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.948+0000 7f14b5e00640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 0x7f1494067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009d20 tx=0x7f14a80090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:18.951+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14b00502b0 con 0x7f14b8159c40 2024-08-17T02:29:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.126+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b8071050 con 0x7f14b8159c40 2024-08-17T02:29:19.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.127+0000 7f14ad600640 1 -- 172.21.15.146:0/907214800 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f14b0001820 con 0x7f14b8159c40 2024-08-17T02:29:19.127 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:19.128 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:29:15.777789+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039307.meta","create_time":"2024-08-17T02:27:03.475416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039307"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039307.data","create_time":"2024-08-17T02:27:04.382680+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039307"}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/4020030705":"2024-08-18T02:29:12.767829+0000","172.21.15.146:6834/4020030705":"2024-08-18T02:29:12.767829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.129+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 msgr2=0x7f1494067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.129+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 0x7f1494067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009d20 tx=0x7f14a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.129+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 msgr2=0x7f14b8150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.129+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c910 tx=0x7f14b00016e0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 shutdown_connections 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f1494065150 0x7f1494067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14b8159c40 0x7f14b8150470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14b80cae60 0x7f14b80aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 --2- 172.21.15.146:0/907214800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14b80ada20 0x7f14b8158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 >> 172.21.15.146:0/907214800 conn(0x7f14b8067750 msgr2=0x7f14b8154260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 shutdown_connections 2024-08-17T02:29:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.130+0000 7f14b7200640 1 -- 172.21.15.146:0/907214800 wait complete. 2024-08-17T02:29:19.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001039307 2024-08-17T02:29:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.296+0000 7f2b1f200640 1 Processor -- start 2024-08-17T02:29:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.296+0000 7f2b1f200640 1 -- start start 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b1f200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2b18156820 0x7f2b180cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b1f200640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180ca050 con 0x7f2b18156bf0 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b1f200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180cabb0 con 0x7f2b180aae40 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b1f200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1815b5d0 con 0x7f2b18156820 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b0f400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2b18156bf0 0x7f2b180aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44406/0 (socket says 172.21.15.146:44406) 2024-08-17T02:29:19.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b0f400640 1 -- 172.21.15.146:0/1931002923 learned_addr learned my addr 172.21.15.146:0/1931002923 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b17e00640 1 --2- 172.21.15.146:0/1931002923 >> v2:172.21.15.150:3300/0 conn(0x7f2b18156820 0x7f2b180cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b17400640 1 -- 172.21.15.146:0/1931002923 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673062565 0 0) 0x7f2b180ca050 con 0x7f2b18156bf0 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.298+0000 7f2b17400640 1 -- 172.21.15.146:0/1931002923 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2afc0034e0 con 0x7f2b18156bf0 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.299+0000 7f2b17e00640 1 -- 172.21.15.146:0/1931002923 >> v1:172.21.15.150:6789/0 conn(0x7f2b180aae40 legacy=0x7f2b180ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.299+0000 7f2b17e00640 1 -- 172.21.15.146:0/1931002923 >> v1:172.21.15.146:6789/0 conn(0x7f2b18156bf0 legacy=0x7f2b180aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.299+0000 7f2b17e00640 1 -- 172.21.15.146:0/1931002923 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180ca280 con 0x7f2b18156820 2024-08-17T02:29:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b17e00640 1 --2- 172.21.15.146:0/1931002923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180cb040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009880 tx=0x7f2b080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=907361f34c7c4a9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b17400640 1 -- 172.21.15.146:0/1931002923 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0802ad90 con 0x7f2b18156820 2024-08-17T02:29:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b17400640 1 -- 172.21.15.146:0/1931002923 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08032440 con 0x7f2b18156820 2024-08-17T02:29:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b17400640 1 -- 172.21.15.146:0/1931002923 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080327e0 con 0x7f2b18156820 2024-08-17T02:29:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b1f200640 1 -- 172.21.15.146:0/1931002923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 msgr2=0x7f2b180cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.300+0000 7f2b1f200640 1 --2- 172.21.15.146:0/1931002923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180cb040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009880 tx=0x7f2b080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.301+0000 7f2b1f200640 1 -- 172.21.15.146:0/1931002923 shutdown_connections 2024-08-17T02:29:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.301+0000 7f2b1f200640 1 --2- 172.21.15.146:0/1931002923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180cb040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.301+0000 7f2b1f200640 1 -- 172.21.15.146:0/1931002923 >> 172.21.15.146:0/1931002923 conn(0x7f2b18066cd0 msgr2=0x7f2b180670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.301+0000 7f2b1f200640 1 -- 172.21.15.146:0/1931002923 shutdown_connections 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.301+0000 7f2b1f200640 1 -- 172.21.15.146:0/1931002923 wait complete. 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.302+0000 7f2b1f200640 1 Processor -- start 2024-08-17T02:29:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.302+0000 7f2b1f200640 1 -- start start 2024-08-17T02:29:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180aae40 0x7f2b180ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181570a0 con 0x7f2b18156bf0 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b18157f00 con 0x7f2b18156820 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1f200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b181572f0 con 0x7f2b180aae40 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1d200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37522/0 (socket says 172.21.15.146:37522) 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b1d200640 1 -- 172.21.15.146:0/2752548547 learned_addr learned my addr 172.21.15.146:0/2752548547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b17e00640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180aae40 0x7f2b180ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.303+0000 7f2b0f400640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 -- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180aae40 msgr2=0x7f2b180ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180aae40 0x7f2b180ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 -- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 msgr2=0x7f2b180acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 -- 172.21.15.146:0/2752548547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08009390 con 0x7f2b18156bf0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b0f400640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1d200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000c890 tx=0x7f2b10001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000ce80 con 0x7f2b18156bf0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000a850 con 0x7f2b18156bf0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000abf0 con 0x7f2b18156bf0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b181575d0 con 0x7f2b18156bf0 2024-08-17T02:29:19.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.304+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b18157b90 con 0x7f2b18156bf0 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.305+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180710c0 con 0x7f2b18156bf0 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.306+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b10012420 con 0x7f2b18156bf0 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.307+0000 7f2b0fe00640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 0x7f2af4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.307+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f2b100826e0 con 0x7f2b18156bf0 2024-08-17T02:29:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.307+0000 7f2b17e00640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 0x7f2af4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.308+0000 7f2b17e00640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 0x7f2af4067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b08034000 tx=0x7f2b08032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.311+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b10050720 con 0x7f2b18156bf0 2024-08-17T02:29:19.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.519+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001039307"} v 0) v1 -- 0x7f2b180ab280 con 0x7f2b18156bf0 2024-08-17T02:29:19.520 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-08-17T02:29:19.520+0000 7fd403600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.525+0000 7f2b0fe00640 1 -- 172.21.15.146:0/2752548547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001039307"}]=0 volume_0000000001039307 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7f2b10053d40 con 0x7f2b18156bf0 2024-08-17T02:29:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:volume_0000000001039307 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 msgr2=0x7f2af4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 0x7f2af4067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2b08034000 tx=0x7f2b08032000 comp rx=0 tx=0).stop 2024-08-17T02:29:19.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 msgr2=0x7f2b18169770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000c890 tx=0x7f2b10001690 comp rx=0 tx=0).stop 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 shutdown_connections 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2af4065150 0x7f2af4067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b18156bf0 0x7f2b18169770 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b18156820 0x7f2b180acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 --2- 172.21.15.146:0/2752548547 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b180aae40 0x7f2b180ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 >> 172.21.15.146:0/2752548547 conn(0x7f2b18066cd0 msgr2=0x7f2b180af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 shutdown_connections 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.527+0000 7f2b1f200640 1 -- 172.21.15.146:0/2752548547 wait complete. 2024-08-17T02:29:19.533 INFO:tasks.ceph.mds.b.smithi150.stderr: -3082> 2024-08-17T02:27:12.231+0000 7fd7bb200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:19.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001039307 --yes-i-really-mean-it 2024-08-17T02:29:19.578 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-08-17T02:29:19.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.693+0000 7f044c400640 1 Processor -- start 2024-08-17T02:29:19.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.693+0000 7f044c400640 1 -- start start 2024-08-17T02:29:19.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f044c400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0444159f10 0x7f0444163a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f044c400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440691a0 con 0x7f0444159430 2024-08-17T02:29:19.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f044c400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440685d0 con 0x7f04440af640 2024-08-17T02:29:19.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f044c400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044415a350 con 0x7f0444159f10 2024-08-17T02:29:19.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f0449a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0444159430 0x7f0444067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44420/0 (socket says 172.21.15.146:44420) 2024-08-17T02:29:19.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.694+0000 7f0449a00640 1 -- 172.21.15.146:0/1873232842 learned_addr learned my addr 172.21.15.146:0/1873232842 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:19.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f044a400640 1 --2- 172.21.15.146:0/1873232842 >> v2:172.21.15.150:3300/0 conn(0x7f0444159f10 0x7f0444163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345531986 0 0) 0x7f04440691a0 con 0x7f0444159430 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f042c0034e0 con 0x7f0444159430 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163957645 0 0) 0x7f04440685d0 con 0x7f04440af640 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04440691a0 con 0x7f04440af640 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1394696000 0 0) 0x7f042c0034e0 con 0x7f0444159430 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 >> v2:172.21.15.150:3300/0 conn(0x7f0444159f10 msgr2=0x7f0444163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 --2- 172.21.15.146:0/1873232842 >> v2:172.21.15.150:3300/0 conn(0x7f0444159f10 0x7f0444163a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 >> v1:172.21.15.150:6789/0 conn(0x7f04440af640 legacy=0x7f0444159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044415b5f0 con 0x7f0444159430 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f04380013f0 con 0x7f0444159430 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 >> v1:172.21.15.146:6789/0 conn(0x7f0444159430 legacy=0x7f0444067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f042c003bb0 0x7f042c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c004780 0x7f042c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 0x7f042c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044415a350 con 0x7f042c005180 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c00c120 con 0x7f042c004780 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.695+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c00c2e0 con 0x7f042c003bb0 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 0x7f042c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f0449a00640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f042c003bb0 0x7f042c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f0449000640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c004780 0x7f042c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 -- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f042c003bb0 msgr2=0x7f042c003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f042c003bb0 0x7f042c003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 -- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c004780 msgr2=0x7f042c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c004780 0x7f042c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.696+0000 7f044a400640 1 -- 172.21.15.146:0/1873232842 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0034e0 con 0x7f042c005180 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.697+0000 7f044a400640 1 -- 172.21.15.146:0/1873232842 reap_dead start 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.697+0000 7f044a400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 0x7f042c00b9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f043c0094d0 tx=0x7f043c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b4c00418835030 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.697+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c02c040 con 0x7f042c005180 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.697+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00f040 con 0x7f042c005180 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.697+0000 7f0443e00640 1 -- 172.21.15.146:0/1873232842 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c030630 con 0x7f042c005180 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 -- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 msgr2=0x7f042c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 0x7f042c00b9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f043c0094d0 tx=0x7f043c00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 -- 172.21.15.146:0/1873232842 shutdown_connections 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 --2- 172.21.15.146:0/1873232842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f042c005180 0x7f042c00b9d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 -- 172.21.15.146:0/1873232842 >> 172.21.15.146:0/1873232842 conn(0x7f0444096a70 msgr2=0x7f0444096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 -- 172.21.15.146:0/1873232842 shutdown_connections 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.698+0000 7f044c400640 1 -- 172.21.15.146:0/1873232842 wait complete. 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.699+0000 7f044c400640 1 Processor -- start 2024-08-17T02:29:19.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 -- start start 2024-08-17T02:29:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 0x7f044415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04441569a0 0x7f044415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044415d750 con 0x7f0444156530 2024-08-17T02:29:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044415e570 con 0x7f042c005180 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.700+0000 7f044c400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044415d960 con 0x7f04441569a0 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37552/0 (socket says 172.21.15.146:37552) 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 -- 172.21.15.146:0/140623780 learned_addr learned my addr 172.21.15.146:0/140623780 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449a00640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 0x7f044415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f044a400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04441569a0 0x7f044415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 -- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04441569a0 msgr2=0x7f044415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04441569a0 0x7f044415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 -- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 msgr2=0x7f044415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 0x7f044415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 -- 172.21.15.146:0/140623780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044415dc40 con 0x7f0444156530 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449a00640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 0x7f044415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.701+0000 7f0449000640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0430002ac0 tx=0x7f0430007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.702+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000fa70 con 0x7f0444156530 2024-08-17T02:29:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.702+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000fbd0 con 0x7f0444156530 2024-08-17T02:29:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.702+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044415df20 con 0x7f0444156530 2024-08-17T02:29:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.702+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430007050 con 0x7f0444156530 2024-08-17T02:29:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.702+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04440b2170 con 0x7f0444156530 2024-08-17T02:29:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.703+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0444071050 con 0x7f0444156530 2024-08-17T02:29:19.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.704+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f04300073c0 con 0x7f0444156530 2024-08-17T02:29:19.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.704+0000 7f0440c00640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 0x7f0424067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.704+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f0430082980 con 0x7f0444156530 2024-08-17T02:29:19.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.705+0000 7f0449a00640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 0x7f0424067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.705+0000 7f0449a00640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 0x7f0424067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0438001b50 tx=0x7f0438009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.708+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f04300508c0 con 0x7f0444156530 2024-08-17T02:29:19.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:19.920+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001039307", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f044406baa0 con 0x7f0444156530 2024-08-17T02:29:20.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.526+0000 7f0440c00640 1 -- 172.21.15.146:0/140623780 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001039307", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7f0430053ee0 con 0x7f0444156530 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 msgr2=0x7f0424067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 0x7f0424067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0438001b50 tx=0x7f0438009040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 msgr2=0x7f044415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0430002ac0 tx=0x7f0430007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 shutdown_connections 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0424065150 0x7f0424067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0444156530 0x7f044415b810 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f04441569a0 0x7f044415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 --2- 172.21.15.146:0/140623780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f042c005180 0x7f044415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.528+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 >> 172.21.15.146:0/140623780 conn(0x7f0444096a70 msgr2=0x7f0444157060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.529+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 shutdown_connections 2024-08-17T02:29:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.529+0000 7f044c400640 1 -- 172.21.15.146:0/140623780 wait complete. 2024-08-17T02:29:20.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001039307.meta cephfs.volume_0000000001039307.meta --yes-i-really-really-mean-it 2024-08-17T02:29:20.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.698+0000 7f902da00640 1 Processor -- start 2024-08-17T02:29:20.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.698+0000 7f902da00640 1 -- start start 2024-08-17T02:29:20.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902da00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90280b5740 0x7f902815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902da00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902815c2e0 0x7f90280aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902da00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280d0a80 con 0x7f90280b2bb0 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902da00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90280b2130 con 0x7f902815c2e0 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902da00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90280b23f0 con 0x7f90280b5740 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902815c2e0 0x7f90280aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f9027e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f90280b2bb0 0x7f90280b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44430/0 (socket says 172.21.15.146:44430) 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f902d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f902815c2e0 0x7f90280aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37554/0 (socket says 172.21.15.146:37554) 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f9027e00640 1 -- 172.21.15.146:0/1337151830 learned_addr learned my addr 172.21.15.146:0/1337151830 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.699+0000 7f9027400640 1 --2- 172.21.15.146:0/1337151830 >> v2:172.21.15.150:3300/0 conn(0x7f90280b5740 0x7f902815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.700+0000 7f902d000640 1 -- 172.21.15.146:0/1337151830 >> v2:172.21.15.150:3300/0 conn(0x7f90280b5740 msgr2=0x7f902815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.700+0000 7f902d000640 1 --2- 172.21.15.146:0/1337151830 >> v2:172.21.15.150:3300/0 conn(0x7f90280b5740 0x7f902815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.700+0000 7f902d000640 1 -- 172.21.15.146:0/1337151830 >> v1:172.21.15.146:6789/0 conn(0x7f90280b2bb0 legacy=0x7f90280b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.700+0000 7f902d000640 1 -- 172.21.15.146:0/1337151830 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280b37a0 con 0x7f902815c2e0 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.700+0000 7f9026a00640 1 -- 172.21.15.146:0/1337151830 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590659539 0 0) 0x7f90280d0a80 con 0x7f90280b2bb0 2024-08-17T02:29:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.701+0000 7f902d000640 1 --2- 172.21.15.146:0/1337151830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280aac20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9020009e60 tx=0x7f9020009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a5b6cb3a74c562 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.701+0000 7f9026a00640 1 -- 172.21.15.146:0/1337151830 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020007550 con 0x7f902815c2e0 2024-08-17T02:29:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.701+0000 7f9026a00640 1 -- 172.21.15.146:0/1337151830 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902002d050 con 0x7f902815c2e0 2024-08-17T02:29:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.701+0000 7f9026a00640 1 -- 172.21.15.146:0/1337151830 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020007900 con 0x7f902815c2e0 2024-08-17T02:29:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 -- 172.21.15.146:0/1337151830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 msgr2=0x7f90280aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 --2- 172.21.15.146:0/1337151830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280aac20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9020009e60 tx=0x7f9020009780 comp rx=0 tx=0).stop 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 -- 172.21.15.146:0/1337151830 shutdown_connections 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 --2- 172.21.15.146:0/1337151830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280aac20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 --2- 172.21.15.146:0/1337151830 >> v2:172.21.15.150:3300/0 conn(0x7f90280b5740 0x7f902815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 -- 172.21.15.146:0/1337151830 >> 172.21.15.146:0/1337151830 conn(0x7f90280cfbc0 msgr2=0x7f90280cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 -- 172.21.15.146:0/1337151830 shutdown_connections 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.702+0000 7f902da00640 1 -- 172.21.15.146:0/1337151830 wait complete. 2024-08-17T02:29:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.703+0000 7f902da00640 1 Processor -- start 2024-08-17T02:29:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.703+0000 7f902da00640 1 -- start start 2024-08-17T02:29:20.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 0x7f902809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280b5740 0x7f9028159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902809a680 con 0x7f902815c2e0 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280ad1d0 con 0x7f90280b5740 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902da00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9028159980 con 0x7f90280b2bb0 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37562/0 (socket says 172.21.15.146:37562) 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f902d000640 1 -- 172.21.15.146:0/3907599154 learned_addr learned my addr 172.21.15.146:0/3907599154 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f9027400640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280b5740 0x7f9028159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.704+0000 7f9027e00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 0x7f902809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 -- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 msgr2=0x7f902809d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 0x7f902809d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 -- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280b5740 msgr2=0x7f9028159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280b5740 0x7f9028159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 -- 172.21.15.146:0/3907599154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009a20 con 0x7f902815c2e0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f9027e00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 0x7f902809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902d000640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f90200097c0 tx=0x7f9020037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020041070 con 0x7f902815c2e0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020031c10 con 0x7f902815c2e0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902809d680 con 0x7f902815c2e0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902003c420 con 0x7f902815c2e0 2024-08-17T02:29:20.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.705+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902809ab70 con 0x7f902815c2e0 2024-08-17T02:29:20.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.706+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9028071050 con 0x7f902815c2e0 2024-08-17T02:29:20.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.707+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9020003040 con 0x7f902815c2e0 2024-08-17T02:29:20.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.708+0000 7f901f400640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 0x7f9008067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.709+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f90200a35d0 con 0x7f902815c2e0 2024-08-17T02:29:20.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.709+0000 7f9027e00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 0x7f9008067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.709+0000 7f9027e00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 0x7f9008067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90180011e0 tx=0x7f9018009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.713+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9020071510 con 0x7f902815c2e0 2024-08-17T02:29:20.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:20.889+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039307.meta", "pool2": "cephfs.volume_0000000001039307.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f902815a610 con 0x7f902815c2e0 2024-08-17T02:29:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.817+0000 7f901f400640 1 -- 172.21.15.146:0/3907599154 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039307.meta", "pool2": "cephfs.volume_0000000001039307.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001039307.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f9020074b30 con 0x7f902815c2e0 2024-08-17T02:29:21.817 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs.volume_0000000001039307.meta' removed 2024-08-17T02:29:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 msgr2=0x7f9008067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 0x7f9008067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f90180011e0 tx=0x7f9018009040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 msgr2=0x7f90280ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f90200097c0 tx=0x7f9020037000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 shutdown_connections 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9008065150 0x7f9008067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f902815c2e0 0x7f90280ab800 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280b5740 0x7f9028159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 --2- 172.21.15.146:0/3907599154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90280b2bb0 0x7f902809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 >> 172.21.15.146:0/3907599154 conn(0x7f90280cfbc0 msgr2=0x7f90280afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 shutdown_connections 2024-08-17T02:29:21.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.820+0000 7f902da00640 1 -- 172.21.15.146:0/3907599154 wait complete. 2024-08-17T02:29:21.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001039307.data cephfs.volume_0000000001039307.data --yes-i-really-really-mean-it 2024-08-17T02:29:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.994+0000 7fa77f000640 1 Processor -- start 2024-08-17T02:29:21.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.994+0000 7fa77f000640 1 -- start start 2024-08-17T02:29:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 0x7fa77806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156c60 0x7fa77806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7780c8130 0x7fa7780c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780ae9b0 con 0x7fa7780c8130 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780ab320 con 0x7fa778156890 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77f000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780aa730 con 0x7fa778156c60 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7780c8130 0x7fa7780c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7780c8130 0x7fa7780c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37570/0 (socket says 172.21.15.146:37570) 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 -- 172.21.15.146:0/3183895251 learned_addr learned my addr 172.21.15.146:0/3183895251 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa777e00640 1 --2- 172.21.15.146:0/3183895251 >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 0x7fa77806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa76f400640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156c60 0x7fa77806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 -- 172.21.15.146:0/3183895251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156c60 msgr2=0x7fa77806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156c60 0x7fa77806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 -- 172.21.15.146:0/3183895251 >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 msgr2=0x7fa77806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 --2- 172.21.15.146:0/3183895251 >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 0x7fa77806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa77d000640 1 -- 172.21.15.146:0/3183895251 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780aa9f0 con 0x7fa7780c8130 2024-08-17T02:29:21.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.996+0000 7fa777e00640 1 --2- 172.21.15.146:0/3183895251 >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 0x7fa77806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.997+0000 7fa77d000640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7780c8130 0x7fa7780c85b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa77806c5c0 tx=0x7fa770009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbf131eac0783cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa777400640 1 -- 172.21.15.146:0/3183895251 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770031400 con 0x7fa7780c8130 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa777400640 1 -- 172.21.15.146:0/3183895251 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77002d050 con 0x7fa7780c8130 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa777400640 1 -- 172.21.15.146:0/3183895251 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700317d0 con 0x7fa7780c8130 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 -- 172.21.15.146:0/3183895251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7780c8130 msgr2=0x7fa7780c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7780c8130 0x7fa7780c85b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa77806c5c0 tx=0x7fa770009840 comp rx=0 tx=0).stop 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 -- 172.21.15.146:0/3183895251 shutdown_connections 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7780c8130 0x7fa7780c85b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 --2- 172.21.15.146:0/3183895251 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156c60 0x7fa77806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 --2- 172.21.15.146:0/3183895251 >> v2:172.21.15.150:3300/0 conn(0x7fa778156890 0x7fa77806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 -- 172.21.15.146:0/3183895251 >> 172.21.15.146:0/3183895251 conn(0x7fa778067750 msgr2=0x7fa77806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 -- 172.21.15.146:0/3183895251 shutdown_connections 2024-08-17T02:29:22.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:21.998+0000 7fa77f000640 1 -- 172.21.15.146:0/3183895251 wait complete. 2024-08-17T02:29:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.000+0000 7fa77f000640 1 Processor -- start 2024-08-17T02:29:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.000+0000 7fa77f000640 1 -- start start 2024-08-17T02:29:22.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 0x7fa77814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156890 0x7fa77814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781513b0 con 0x7fa778156c60 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815d010 con 0x7fa7780c8130 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77f000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815c160 con 0x7fa778156890 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37576/0 (socket says 172.21.15.146:37576) 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 -- 172.21.15.146:0/882697312 learned_addr learned my addr 172.21.15.146:0/882697312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa777e00640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 0x7fa77814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa76f400640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156890 0x7fa77814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 -- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156890 msgr2=0x7fa77814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156890 0x7fa77814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 -- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 msgr2=0x7fa77814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 0x7fa77814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa77d000640 1 -- 172.21.15.146:0/882697312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009ae0 con 0x7fa778156c60 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.001+0000 7fa777e00640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 0x7fa77814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa77d000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa77002acd0 tx=0x7fa770034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770008e50 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77003b410 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77815c400 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77003b7d0 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.002+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77815c9c0 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.003+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77815d1a0 con 0x7fa778156c60 2024-08-17T02:29:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.004+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa770038050 con 0x7fa778156c60 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.005+0000 7fa76fe00640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 0x7fa754067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.005+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fa7700a2a10 con 0x7fa778156c60 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.005+0000 7fa777e00640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 0x7fa754067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.005+0000 7fa777e00640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 0x7fa754067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa768006e70 tx=0x7fa768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.008+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa770070b30 con 0x7fa778156c60 2024-08-17T02:29:22.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.180+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039307.data", "pool2": "cephfs.volume_0000000001039307.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7780710c0 con 0x7fa778156c60 2024-08-17T02:29:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs.volume_0000000001039307.data' removed 2024-08-17T02:29:22.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.824+0000 7fa76fe00640 1 -- 172.21.15.146:0/882697312 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039307.data", "pool2": "cephfs.volume_0000000001039307.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001039307.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7fa770074150 con 0x7fa778156c60 2024-08-17T02:29:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.827+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 msgr2=0x7fa754067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.827+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 0x7fa754067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa768006e70 tx=0x7fa768008040 comp rx=0 tx=0).stop 2024-08-17T02:29:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.827+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 msgr2=0x7fa77815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.827+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa77002acd0 tx=0x7fa770034000 comp rx=0 tx=0).stop 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 shutdown_connections 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa754065150 0x7fa754067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa778156c60 0x7fa77815a4d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa778156890 0x7fa77814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 --2- 172.21.15.146:0/882697312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7780c8130 0x7fa77814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 >> 172.21.15.146:0/882697312 conn(0x7fa778067750 msgr2=0x7fa7780ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 shutdown_connections 2024-08-17T02:29:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.828+0000 7fa77f000640 1 -- 172.21.15.146:0/882697312 wait complete. 2024-08-17T02:29:22.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:29:22.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.996+0000 7f97e8600640 1 Processor -- start 2024-08-17T02:29:22.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.996+0000 7f97e8600640 1 -- start start 2024-08-17T02:29:22.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.997+0000 7f97e8600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97e0156d60 0x7f97e00ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e8600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e00adcf0 0x7f97e00ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e8600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e015b030 con 0x7f97e0156990 2024-08-17T02:29:22.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e8600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e00ae130 con 0x7f97e0156d60 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e8600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00cc2e0 con 0x7f97e00adcf0 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97e0156d60 0x7f97e00ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97e0156d60 0x7f97e00ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37584/0 (socket says 172.21.15.146:37584) 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 -- 172.21.15.146:0/1936492371 learned_addr learned my addr 172.21.15.146:0/1936492371 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e6600640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e00adcf0 0x7f97e00ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 -- 172.21.15.146:0/1936492371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e00adcf0 msgr2=0x7f97e00ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e00adcf0 0x7f97e00ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 -- 172.21.15.146:0/1936492371 >> v1:172.21.15.150:6789/0 conn(0x7f97e0156990 legacy=0x7f97e00b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.998+0000 7f97e5200640 1 -- 172.21.15.146:0/1936492371 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00b1110 con 0x7f97e0156d60 2024-08-17T02:29:23.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:22.999+0000 7f97e5200640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e0156d60 0x7f97e00ad7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009910 tx=0x7f97cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb2163b8cdc9770 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97dfe00640 1 -- 172.21.15.146:0/1936492371 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc02ae40 con 0x7f97e0156d60 2024-08-17T02:29:23.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97dfe00640 1 -- 172.21.15.146:0/1936492371 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc032440 con 0x7f97e0156d60 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97dfe00640 1 -- 172.21.15.146:0/1936492371 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc032820 con 0x7f97e0156d60 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 -- 172.21.15.146:0/1936492371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e0156d60 msgr2=0x7f97e00ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e0156d60 0x7f97e00ad7b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009910 tx=0x7f97cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 -- 172.21.15.146:0/1936492371 shutdown_connections 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e00adcf0 0x7f97e00ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 --2- 172.21.15.146:0/1936492371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e0156d60 0x7f97e00ad7b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 -- 172.21.15.146:0/1936492371 >> 172.21.15.146:0/1936492371 conn(0x7f97e0067750 msgr2=0x7f97e00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 -- 172.21.15.146:0/1936492371 shutdown_connections 2024-08-17T02:29:23.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.000+0000 7f97e8600640 1 -- 172.21.15.146:0/1936492371 wait complete. 2024-08-17T02:29:23.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.002+0000 7f97e8600640 1 Processor -- start 2024-08-17T02:29:23.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.002+0000 7f97e8600640 1 -- start start 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e0156990 0x7f97e0157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 0x7f97e00aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00a98e0 con 0x7f97e00adcf0 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00a9b30 con 0x7f97e0156990 2024-08-17T02:29:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e8600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e00a9e10 con 0x7f97e0156d60 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e5c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37598/0 (socket says 172.21.15.146:37598) 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e5c00640 1 -- 172.21.15.146:0/1253269285 learned_addr learned my addr 172.21.15.146:0/1253269285 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e5200640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e0156990 0x7f97e0157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.003+0000 7f97e6600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 0x7f97e00aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 -- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 msgr2=0x7f97e00aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 0x7f97e00aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 -- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e0156990 msgr2=0x7f97e0157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e0156990 0x7f97e0157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 -- 172.21.15.146:0/1253269285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009450 con 0x7f97e00adcf0 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e6600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 0x7f97e00aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e5c00640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c560 tx=0x7f97d4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011590 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4011710 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011ad0 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e00aa0f0 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.004+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e00acdd0 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.005+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e00aa5f0 con 0x7f97e00adcf0 2024-08-17T02:29:23.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.006+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97d401b3b0 con 0x7f97e00adcf0 2024-08-17T02:29:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.007+0000 7f97dcc00640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 0x7f97c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.007+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f97d4081740 con 0x7f97e00adcf0 2024-08-17T02:29:23.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.007+0000 7f97e5200640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 0x7f97c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.008+0000 7f97e5200640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 0x7f97c0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97cc034000 tx=0x7f97cc032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.011+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97d404fab0 con 0x7f97e00adcf0 2024-08-17T02:29:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.189+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f97e0071050 con 0x7f97e00adcf0 2024-08-17T02:29:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.193+0000 7f97dcc00640 1 -- 172.21.15.146:0/1253269285 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f97d40170a0 con 0x7f97e00adcf0 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.195+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 msgr2=0x7f97c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.195+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 0x7f97c0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97cc034000 tx=0x7f97cc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.195+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 msgr2=0x7f97e00ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.195+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c560 tx=0x7f97d4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 shutdown_connections 2024-08-17T02:29:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f97c0065150 0x7f97c0067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f97e0156d60 0x7f97e00aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97e0156990 0x7f97e0157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 --2- 172.21.15.146:0/1253269285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97e00adcf0 0x7f97e00ac890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 >> 172.21.15.146:0/1253269285 conn(0x7f97e0067750 msgr2=0x7f97e01542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 shutdown_connections 2024-08-17T02:29:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.196+0000 7f97e8600640 1 -- 172.21.15.146:0/1253269285 wait complete. 2024-08-17T02:29:23.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.359+0000 7f717cc00640 1 Processor -- start 2024-08-17T02:29:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.359+0000 7f717cc00640 1 -- start start 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.360+0000 7f717cc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71781401b0 0x7f71780caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f717cc00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780caa80 con 0x7f71780b1440 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f717cc00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780c9e70 con 0x7f7178140580 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f717cc00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780cb450 con 0x7f71781401b0 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7175e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71781401b0 0x7f71780caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7176800640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71780b1440 0x7f71780c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44442/0 (socket says 172.21.15.146:44442) 2024-08-17T02:29:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7176800640 1 -- 172.21.15.146:0/4253978677 learned_addr learned my addr 172.21.15.146:0/4253978677 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7175e00640 1 -- 172.21.15.146:0/4253978677 >> v1:172.21.15.150:6789/0 conn(0x7f7178140580 legacy=0x7f71780b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7175e00640 1 -- 172.21.15.146:0/4253978677 >> v1:172.21.15.146:6789/0 conn(0x7f71780b1440 legacy=0x7f71780c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7175e00640 1 -- 172.21.15.146:0/4253978677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780ca150 con 0x7f71781401b0 2024-08-17T02:29:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.361+0000 7f7174a00640 1 -- 172.21.15.146:0/4253978677 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780682287 0 0) 0x7f71780caa80 con 0x7f71780b1440 2024-08-17T02:29:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.362+0000 7f7175e00640 1 --2- 172.21.15.146:0/4253978677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71781401b0 0x7f71780caf10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7168009850 tx=0x7f71680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeb9c9b013ffdc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.362+0000 7f7174a00640 1 -- 172.21.15.146:0/4253978677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716802ad00 con 0x7f71781401b0 2024-08-17T02:29:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f7174a00640 1 -- 172.21.15.146:0/4253978677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716802ae60 con 0x7f71781401b0 2024-08-17T02:29:23.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f7174a00640 1 -- 172.21.15.146:0/4253978677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168032670 con 0x7f71781401b0 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 -- 172.21.15.146:0/4253978677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71781401b0 msgr2=0x7f71780caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 --2- 172.21.15.146:0/4253978677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71781401b0 0x7f71780caf10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7168009850 tx=0x7f71680090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 -- 172.21.15.146:0/4253978677 shutdown_connections 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 --2- 172.21.15.146:0/4253978677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71781401b0 0x7f71780caf10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 -- 172.21.15.146:0/4253978677 >> 172.21.15.146:0/4253978677 conn(0x7f71780cb9b0 msgr2=0x7f71780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 -- 172.21.15.146:0/4253978677 shutdown_connections 2024-08-17T02:29:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.363+0000 7f717cc00640 1 -- 172.21.15.146:0/4253978677 wait complete. 2024-08-17T02:29:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.365+0000 7f717cc00640 1 Processor -- start 2024-08-17T02:29:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.365+0000 7f717cc00640 1 -- start start 2024-08-17T02:29:23.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.365+0000 7f717cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f717cc00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 0x7f7178132f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f717cc00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 0x7f717815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f717cc00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178134610 con 0x7f71780b1440 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f717cc00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178133a00 con 0x7f7178140580 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f717cc00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178133ce0 con 0x7f71781401b0 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37624/0 (socket says 172.21.15.146:37624) 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 -- 172.21.15.146:0/1671004959 learned_addr learned my addr 172.21.15.146:0/1671004959 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7176800640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 0x7f717815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175400640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 0x7f7178132f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 -- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 msgr2=0x7f7178132f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 0x7f7178132f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 -- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 msgr2=0x7f717815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 0x7f717815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175e00640 1 -- 172.21.15.146:0/1671004959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168009390 con 0x7f71780b1440 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7176800640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 0x7f717815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.366+0000 7f7175400640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 0x7f7178132f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f7175e00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7168009360 tx=0x7f7168032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168032e20 con 0x7f71780b1440 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7168031a60 con 0x7f71780b1440 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168031e20 con 0x7f71780b1440 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7178133fc0 con 0x7f71780b1440 2024-08-17T02:29:23.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.367+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780a78c0 con 0x7f71780b1440 2024-08-17T02:29:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.368+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178064db0 con 0x7f71780b1440 2024-08-17T02:29:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.369+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7168044030 con 0x7f71780b1440 2024-08-17T02:29:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.370+0000 7f716d600640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.370+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7168042070 con 0x7f71780b1440 2024-08-17T02:29:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.370+0000 7f7175400640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.370+0000 7f7175400640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 0x7f7158067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71780b0250 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.373+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7168071060 con 0x7f71780b1440 2024-08-17T02:29:23.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.611+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f71780c9380 con 0x7f71780b1440 2024-08-17T02:29:23.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.825+0000 7f716d600640 1 -- 172.21.15.146:0/1671004959 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v163) v1 ==== 135+0+0 (secure 0 0 0) 0x7f71680370c0 con 0x7f71780b1440 2024-08-17T02:29:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 msgr2=0x7f7158067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 0x7f7158067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71780b0250 tx=0x7f7164009040 comp rx=0 tx=0).stop 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 msgr2=0x7f71780aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7168009360 tx=0x7f7168032000 comp rx=0 tx=0).stop 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 shutdown_connections 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f7158065150 0x7f7158067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7178140580 0x7f717815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71781401b0 0x7f7178132f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 --2- 172.21.15.146:0/1671004959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71780b1440 0x7f71780aecc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 >> 172.21.15.146:0/1671004959 conn(0x7f71780cb9b0 msgr2=0x7f717813f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 shutdown_connections 2024-08-17T02:29:23.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:23.827+0000 7f717cc00640 1 -- 172.21.15.146:0/1671004959 wait complete. 2024-08-17T02:29:23.846 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:29:23.846 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:23.846 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:23.846 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:23.846 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:23.847 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039307 --yes-i-really-mean-it' 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.515s 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:29:23.848 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:29:23.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039307 --yes-i-really-mean-it' 2024-08-17T02:29:23.850 INFO:tasks.cephfs_test_runner: 2024-08-17T02:29:23.850 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:24.075 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ea7c67fb8f6343c3a7f3aec91c0349c5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:24.077 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:29:24.086 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:29:24.095 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:29:24.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.095 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:29:24.133 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:24.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:29:24.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:24.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:24.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.810 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-08-17T02:29:24.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.947 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:24.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:24.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.951 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:29:24.991 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:24.991 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:29:24.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:25.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.093 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:25.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-08-17T02:29:25.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.593 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-08-17T02:29:25.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-08-17T02:29:25.729 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:25.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:25.732 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:29:25.743 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:29:25.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.896+0000 7f9e7f200640 1 Processor -- start 2024-08-17T02:29:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.897+0000 7f9e7f200640 1 -- start start 2024-08-17T02:29:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7f200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e80155900 0x7f9e80155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7f200640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 0x7f9e800ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7f200640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e80157690 con 0x7f9e800b0270 2024-08-17T02:29:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7f200640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e80156a80 con 0x7f9e80155900 2024-08-17T02:29:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7f200640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e80156d60 con 0x7f9e80158b30 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e80155900 0x7f9e80155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7de00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e80155900 0x7f9e80155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51684/0 (socket says 172.21.15.146:51684) 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7de00640 1 -- 172.21.15.146:0/218625264 learned_addr learned my addr 172.21.15.146:0/218625264 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e77e00640 1 --1- 172.21.15.146:0/218625264 >> v1:172.21.15.150:6789/0 conn(0x7f9e800b0270 0x7f9e80156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:38528/0 (socket says 172.21.15.146:38528) 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.898+0000 7f9e7e800640 1 --2- 172.21.15.146:0/218625264 >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 0x7f9e800ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.899+0000 7f9e7de00640 1 -- 172.21.15.146:0/218625264 >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 msgr2=0x7f9e800ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.899+0000 7f9e7de00640 1 --2- 172.21.15.146:0/218625264 >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 0x7f9e800ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.899+0000 7f9e7de00640 1 -- 172.21.15.146:0/218625264 >> v1:172.21.15.150:6789/0 conn(0x7f9e800b0270 legacy=0x7f9e80156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.899+0000 7f9e7de00640 1 -- 172.21.15.146:0/218625264 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80157040 con 0x7f9e80155900 2024-08-17T02:29:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.899+0000 7f9e7e800640 1 --2- 172.21.15.146:0/218625264 >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 0x7f9e800ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7de00640 1 --2- 172.21.15.146:0/218625264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e80155900 0x7f9e80155cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b06c0 tx=0x7f9e700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be78ad95cfb8bfed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7d400640 1 -- 172.21.15.146:0/218625264 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70031510 con 0x7f9e80155900 2024-08-17T02:29:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7d400640 1 -- 172.21.15.146:0/218625264 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7002f050 con 0x7f9e80155900 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7d400640 1 -- 172.21.15.146:0/218625264 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700318e0 con 0x7f9e80155900 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 -- 172.21.15.146:0/218625264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e80155900 msgr2=0x7f9e80155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 --2- 172.21.15.146:0/218625264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e80155900 0x7f9e80155cd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b06c0 tx=0x7f9e700091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 -- 172.21.15.146:0/218625264 shutdown_connections 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 --2- 172.21.15.146:0/218625264 >> v2:172.21.15.150:3300/0 conn(0x7f9e80158b30 0x7f9e800ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 --2- 172.21.15.146:0/218625264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e80155900 0x7f9e80155cd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.900+0000 7f9e7f200640 1 -- 172.21.15.146:0/218625264 >> 172.21.15.146:0/218625264 conn(0x7f9e80067750 msgr2=0x7f9e800cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.901+0000 7f9e7f200640 1 -- 172.21.15.146:0/218625264 shutdown_connections 2024-08-17T02:29:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.901+0000 7f9e7f200640 1 -- 172.21.15.146:0/218625264 wait complete. 2024-08-17T02:29:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.902+0000 7f9e7f200640 1 Processor -- start 2024-08-17T02:29:25.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.902+0000 7f9e7f200640 1 -- start start 2024-08-17T02:29:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e80155900 0x7f9e800c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e80158b30 0x7f9e800c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80154860 con 0x7f9e800b0270 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c87d0 con 0x7f9e80158b30 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7f200640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c81e0 con 0x7f9e80155900 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.903+0000 7f9e7de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51686/0 (socket says 172.21.15.146:51686) 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 -- 172.21.15.146:0/1049348509 learned_addr learned my addr 172.21.15.146:0/1049348509 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e77e00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e80155900 0x7f9e800c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7e800640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e80158b30 0x7f9e800c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 -- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e80155900 msgr2=0x7f9e800c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e80155900 0x7f9e800c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 -- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e80158b30 msgr2=0x7f9e800c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e80158b30 0x7f9e800c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 -- 172.21.15.146:0/1049348509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70009450 con 0x7f9e800b0270 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.904+0000 7f9e7de00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009210 tx=0x7f9e70037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.905+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70033890 con 0x7f9e800b0270 2024-08-17T02:29:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.905+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70033a10 con 0x7f9e800b0270 2024-08-17T02:29:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.905+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e800ca500 con 0x7f9e800b0270 2024-08-17T02:29:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.905+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70033e10 con 0x7f9e800b0270 2024-08-17T02:29:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.905+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800ac290 con 0x7f9e800b0270 2024-08-17T02:29:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.906+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800ac4b0 con 0x7f9e800b0270 2024-08-17T02:29:25.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.906+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e7002cd50 con 0x7f9e800b0270 2024-08-17T02:29:25.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.907+0000 7f9e75600640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 0x7f9e5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.907+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9e700a2fe0 con 0x7f9e800b0270 2024-08-17T02:29:25.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.908+0000 7f9e77e00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 0x7f9e5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.908+0000 7f9e77e00640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 0x7f9e5c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b0a60 tx=0x7f9e68007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:25.911+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e70071350 con 0x7f9e800b0270 2024-08-17T02:29:26.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.085+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e80071050 con 0x7f9e800b0270 2024-08-17T02:29:26.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.086+0000 7f9e75600640 1 -- 172.21.15.146:0/1049348509 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f9e70074970 con 0x7f9e800b0270 2024-08-17T02:29:26.086 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:26.087 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":43,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:29:22.816626+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/414928528":"2024-08-18T02:29:19.520343+0000","172.21.15.150:6833/414928528":"2024-08-18T02:29:19.520343+0000","172.21.15.146:6835/4020030705":"2024-08-18T02:29:12.767829+0000","172.21.15.146:6834/4020030705":"2024-08-18T02:29:12.767829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.088+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 msgr2=0x7f9e5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.088+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 0x7f9e5c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b0a60 tx=0x7f9e68007e20 comp rx=0 tx=0).stop 2024-08-17T02:29:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.088+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 msgr2=0x7f9e80154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.088+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009210 tx=0x7f9e70037000 comp rx=0 tx=0).stop 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.088+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 shutdown_connections 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e5c065150 0x7f9e5c067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9e80158b30 0x7f9e800c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9e80155900 0x7f9e800c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 --2- 172.21.15.146:0/1049348509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e800b0270 0x7f9e80154320 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 >> 172.21.15.146:0/1049348509 conn(0x7f9e80067750 msgr2=0x7f9e80157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 shutdown_connections 2024-08-17T02:29:26.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.089+0000 7f9e7f200640 1 -- 172.21.15.146:0/1049348509 wait complete. 2024-08-17T02:29:26.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:26.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:26.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.253+0000 7fa057c00640 1 Processor -- start 2024-08-17T02:29:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.253+0000 7fa057c00640 1 -- start start 2024-08-17T02:29:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa057c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa05006df00 0x7fa0500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa057c00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa050155df0 0x7fa0500ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa057c00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa050156670 con 0x7fa050155a20 2024-08-17T02:29:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa057c00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500b0350 con 0x7fa050155df0 2024-08-17T02:29:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa057c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05006e5e0 con 0x7fa05006df00 2024-08-17T02:29:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa055200640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa050155a20 0x7fa05006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42412/0 (socket says 172.21.15.146:42412) 2024-08-17T02:29:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa055200640 1 -- 172.21.15.146:0/1509327236 learned_addr learned my addr 172.21.15.146:0/1509327236 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa055c00640 1 --2- 172.21.15.146:0/1509327236 >> v2:172.21.15.146:3300/0 conn(0x7fa050155df0 0x7fa0500ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa047e00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa05006df00 0x7fa0500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.255+0000 7fa04fe00640 1 -- 172.21.15.146:0/1509327236 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254151831 0 0) 0x7fa050156670 con 0x7fa050155a20 2024-08-17T02:29:26.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.256+0000 7fa04fe00640 1 -- 172.21.15.146:0/1509327236 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0340034e0 con 0x7fa050155a20 2024-08-17T02:29:26.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.256+0000 7fa055c00640 1 -- 172.21.15.146:0/1509327236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa05006df00 msgr2=0x7fa0500adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:26.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.256+0000 7fa055c00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa05006df00 0x7fa0500adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.256+0000 7fa055c00640 1 -- 172.21.15.146:0/1509327236 >> v1:172.21.15.146:6789/0 conn(0x7fa050155a20 legacy=0x7fa05006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.256+0000 7fa055c00640 1 -- 172.21.15.146:0/1509327236 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05006e8c0 con 0x7fa050155df0 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa055c00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa0500ad9b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e60 tx=0x7fa048009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4bf6cb213fda0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa04fe00640 1 -- 172.21.15.146:0/1509327236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048007550 con 0x7fa050155df0 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa04fe00640 1 -- 172.21.15.146:0/1509327236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04802d050 con 0x7fa050155df0 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa04fe00640 1 -- 172.21.15.146:0/1509327236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048007920 con 0x7fa050155df0 2024-08-17T02:29:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa057c00640 1 -- 172.21.15.146:0/1509327236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 msgr2=0x7fa0500ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.257+0000 7fa057c00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa0500ad9b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e60 tx=0x7fa048009780 comp rx=0 tx=0).stop 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 -- 172.21.15.146:0/1509327236 shutdown_connections 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa0500ad9b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 --2- 172.21.15.146:0/1509327236 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa05006df00 0x7fa0500adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 -- 172.21.15.146:0/1509327236 >> 172.21.15.146:0/1509327236 conn(0x7fa0500cb9b0 msgr2=0x7fa0500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 -- 172.21.15.146:0/1509327236 shutdown_connections 2024-08-17T02:29:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.258+0000 7fa057c00640 1 -- 172.21.15.146:0/1509327236 wait complete. 2024-08-17T02:29:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.259+0000 7fa057c00640 1 Processor -- start 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.259+0000 7fa057c00640 1 -- start start 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 0x7fa050159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa050155a20 0x7fa0501520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa05015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015b010 con 0x7fa050155df0 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015b2f0 con 0x7fa05006df00 2024-08-17T02:29:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa057c00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015b5d0 con 0x7fa050155a20 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.260+0000 7fa055c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa05015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 0x7fa050159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa047e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa050155a20 0x7fa0501520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055c00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa05015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51698/0 (socket says 172.21.15.146:51698) 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055c00640 1 -- 172.21.15.146:0/357087237 learned_addr learned my addr 172.21.15.146:0/357087237 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 -- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa050155a20 msgr2=0x7fa0501520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa050155a20 0x7fa0501520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 -- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 msgr2=0x7fa05015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa05015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 -- 172.21.15.146:0/357087237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048009a20 con 0x7fa05006df00 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa055200640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 0x7fa050159bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa040001ed0 tx=0x7fa040007cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.261+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040005aa0 con 0x7fa05006df00 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.262+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040005c20 con 0x7fa05006df00 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.262+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040007320 con 0x7fa05006df00 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.262+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05015b8b0 con 0x7fa05006df00 2024-08-17T02:29:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.262+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05015a110 con 0x7fa05006df00 2024-08-17T02:29:26.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.263+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa050064db0 con 0x7fa05006df00 2024-08-17T02:29:26.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.264+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa04001b3b0 con 0x7fa05006df00 2024-08-17T02:29:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.264+0000 7fa04cc00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 0x7fa02c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.264+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa0400816d0 con 0x7fa05006df00 2024-08-17T02:29:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.265+0000 7fa047e00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 0x7fa02c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.265+0000 7fa047e00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 0x7fa02c067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa050152b10 tx=0x7fa0380090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.269+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa04004fa40 con 0x7fa05006df00 2024-08-17T02:29:26.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.442+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa05015b430 con 0x7fa02c065150 2024-08-17T02:29:26.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.444+0000 7fa04cc00640 1 -- 172.21.15.146:0/357087237 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50543 (secure 0 0 0) 0x7fa05015b430 con 0x7fa02c065150 2024-08-17T02:29:26.445 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:29:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.446+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 msgr2=0x7fa02c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.446+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 0x7fa02c067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa050152b10 tx=0x7fa0380090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.446+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 msgr2=0x7fa050159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.446+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 0x7fa050159bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa040001ed0 tx=0x7fa040007cc0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 shutdown_connections 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa02c065150 0x7fa02c067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa050155df0 0x7fa05015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa050155a20 0x7fa0501520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 --2- 172.21.15.146:0/357087237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa05006df00 0x7fa050159bd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 >> 172.21.15.146:0/357087237 conn(0x7fa0500cb9b0 msgr2=0x7fa0501544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 shutdown_connections 2024-08-17T02:29:26.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.447+0000 7fa057c00640 1 -- 172.21.15.146:0/357087237 wait complete. 2024-08-17T02:29:26.461 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:29:26.375759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388188,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586532,"statfs":{"total":773094113280,"available":770648608768,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.852644"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:21.821589+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:29:21.821589+0000","last_peered":"2024-08-17T02:29:21.821589+0000","last_clean":"2024-08-17T02:29:21.821589+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:29:21.821589+0000","last_undegraded":"2024-08-17T02:29:21.821589+0000","last_fullsized":"2024-08-17T02:29:21.821589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.629,"15min":0.59999999999999998},"min":{"1min":0.56299999999999994,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":0.93899999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72499999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.755,"15min":0.749},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.58799999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.95799999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.23,"15min":1.23},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93000000000000005,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.435,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78100000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83499999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88300000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":1.115,"15min":1.115},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73199999999999998,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":1.135,"15min":1.135},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69199999999999995},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.86499999999999999,"5min":3.569,"15min":3.569},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":2.016,"15min":2.016},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.872,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93999999999999995,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.67900000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.67100000000000004,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92000000000000004,"5min":2.052,"15min":2.052},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.88400000000000001,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.65800000000000003,"15min":0.61199999999999999},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83899999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.91600000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":1.266,"15min":1.266},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69799999999999995,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.70599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.626}]},{"osd":4,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":1.161,"15min":1.161},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.208,"15min":1.208},"last":0.498},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":1.3,"15min":1.3},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.56699999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.746}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90400000000000003,"5min":1.623,"15min":1.623},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.62,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98899999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.621,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.661,"15min":1.661},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92400000000000004,"5min":1.758,"15min":1.758},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.44,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77700000000000002,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85399999999999998,"5min":1.087,"15min":1.087},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0129999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":3.226,"15min":3.226},"last":0.439},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.53600000000000003,"15min":0.57399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.901,"15min":1.901},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":2.75,"15min":2.75},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.081,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.94299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1020000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":1.052}]},{"osd":5,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.0580000000000001,"5min":3.581,"15min":3.581},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.153,"5min":3.157,"15min":3.157},"last":1.073}]},{"osd":6,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.117,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.91800000000000004,"15min":0.95499999999999996},"min":{"1min":0.69299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1339999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.002,"5min":3.496,"15min":3.496},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.98699999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0329999999999999,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.96999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.52300000000000002},"min":{"1min":0.32600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.624,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67600000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.907,"15min":1.907},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.77200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":5.577,"15min":5.577},"last":0.504}]},{"osd":3,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.05,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.90600000000000003},"min":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97499999999999998,"5min":3.226,"15min":3.226},"last":0.621},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94199999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.875},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.90100000000000002},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0649999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85599999999999998,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":3.028,"15min":3.028},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0780000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.621,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0149999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.94899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77100000000000002},"min":{"1min":0.59399999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.083,"15min":1.083},"last":1.054},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.024,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.95799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.40899999999999997},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.753,"15min":0.753},"last":0.438}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.505,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.498}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.96699999999999997,"5min":1.288,"15min":1.288},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":1.208,"15min":1.208},"last":0.627},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.61099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94499999999999995,"5min":1.135,"15min":1.135},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.77100000000000002},"min":{"1min":0.67300000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.95499999999999996,"5min":1.448,"15min":1.448},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96399999999999997,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:26.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:26.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.613+0000 7fbc91e00640 1 Processor -- start 2024-08-17T02:29:26.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.613+0000 7fbc91e00640 1 -- start start 2024-08-17T02:29:26.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.614+0000 7fbc91e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc8c06d7a0 0x7fbc8c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.614+0000 7fbc91e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc91e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c0ae250 con 0x7fbc8c15ccc0 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc91e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c06e820 con 0x7fbc8c0acf10 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc91e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0ad640 con 0x7fbc8c06d7a0 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51706/0 (socket says 172.21.15.146:51706) 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 -- 172.21.15.146:0/682507892 learned_addr learned my addr 172.21.15.146:0/682507892 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc90a00640 1 --2- 172.21.15.146:0/682507892 >> v2:172.21.15.150:3300/0 conn(0x7fbc8c06d7a0 0x7fbc8c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 -- 172.21.15.146:0/682507892 >> v2:172.21.15.150:3300/0 conn(0x7fbc8c06d7a0 msgr2=0x7fbc8c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:26.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 --2- 172.21.15.146:0/682507892 >> v2:172.21.15.150:3300/0 conn(0x7fbc8c06d7a0 0x7fbc8c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 -- 172.21.15.146:0/682507892 >> v1:172.21.15.150:6789/0 conn(0x7fbc8c15ccc0 legacy=0x7fbc8c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.615+0000 7fbc8be00640 1 -- 172.21.15.146:0/682507892 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0ad920 con 0x7fbc8c0acf10 2024-08-17T02:29:26.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.616+0000 7fbc8be00640 1 --2- 172.21.15.146:0/682507892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0704a0 tx=0x7fbc780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b349937df9c0e184 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc8b400640 1 -- 172.21.15.146:0/682507892 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7802ae80 con 0x7fbc8c0acf10 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc8b400640 1 -- 172.21.15.146:0/682507892 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc78032440 con 0x7fbc8c0acf10 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc8b400640 1 -- 172.21.15.146:0/682507892 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78032800 con 0x7fbc8c0acf10 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 -- 172.21.15.146:0/682507892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 msgr2=0x7fbc8c06e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 --2- 172.21.15.146:0/682507892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0704a0 tx=0x7fbc780091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 -- 172.21.15.146:0/682507892 shutdown_connections 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 --2- 172.21.15.146:0/682507892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c06e2e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 --2- 172.21.15.146:0/682507892 >> v2:172.21.15.150:3300/0 conn(0x7fbc8c06d7a0 0x7fbc8c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 -- 172.21.15.146:0/682507892 >> 172.21.15.146:0/682507892 conn(0x7fbc8c067750 msgr2=0x7fbc8c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 -- 172.21.15.146:0/682507892 shutdown_connections 2024-08-17T02:29:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.617+0000 7fbc91e00640 1 -- 172.21.15.146:0/682507892 wait complete. 2024-08-17T02:29:26.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.619+0000 7fbc91e00640 1 Processor -- start 2024-08-17T02:29:26.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.619+0000 7fbc91e00640 1 -- start start 2024-08-17T02:29:26.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc8c06d7a0 0x7fbc8c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc8c15ccc0 0x7fbc8c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c15b4c0 con 0x7fbc8c0acf10 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c15a8b0 con 0x7fbc8c06d7a0 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c15ab90 con 0x7fbc8c15ccc0 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51708/0 (socket says 172.21.15.146:51708) 2024-08-17T02:29:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 -- 172.21.15.146:0/170208951 learned_addr learned my addr 172.21.15.146:0/170208951 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc90a00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc8c06d7a0 0x7fbc8c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc91400640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc8c15ccc0 0x7fbc8c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 -- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc8c15ccc0 msgr2=0x7fbc8c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc8c15ccc0 0x7fbc8c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 -- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc8c06d7a0 msgr2=0x7fbc8c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc8c06d7a0 0x7fbc8c0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.620+0000 7fbc8be00640 1 -- 172.21.15.146:0/170208951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78009450 con 0x7fbc8c0acf10 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc8be00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009210 tx=0x7fbc78032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78031bb0 con 0x7fbc8c0acf10 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc78031d30 con 0x7fbc8c0acf10 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7803d670 con 0x7fbc8c0acf10 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c15ae70 con 0x7fbc8c0acf10 2024-08-17T02:29:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.621+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c0cb080 con 0x7fbc8c0acf10 2024-08-17T02:29:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.622+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c15b630 con 0x7fbc8c0acf10 2024-08-17T02:29:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.623+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc78039040 con 0x7fbc8c0acf10 2024-08-17T02:29:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.624+0000 7fbc7fe00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 0x7fbc6c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.624+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbc780a1f50 con 0x7fbc8c0acf10 2024-08-17T02:29:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.624+0000 7fbc90a00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 0x7fbc6c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.625+0000 7fbc90a00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 0x7fbc6c067630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009d20 tx=0x7fbc800090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.628+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc78070360 con 0x7fbc8c0acf10 2024-08-17T02:29:26.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.800+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc8c071050 con 0x7fbc6c065180 2024-08-17T02:29:26.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.802+0000 7fbc7fe00640 1 -- 172.21.15.146:0/170208951 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50543 (secure 0 0 0) 0x7fbc8c071050 con 0x7fbc6c065180 2024-08-17T02:29:26.803 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:26.804 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 msgr2=0x7fbc6c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 0x7fbc6c067630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009d20 tx=0x7fbc800090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 msgr2=0x7fbc8c163100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009210 tx=0x7fbc78032000 comp rx=0 tx=0).stop 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 shutdown_connections 2024-08-17T02:29:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fbc6c065180 0x7fbc6c067630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8c0acf10 0x7fbc8c163100 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.804+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc8c15ccc0 0x7fbc8c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.805+0000 7fbc91e00640 1 --2- 172.21.15.146:0/170208951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc8c06d7a0 0x7fbc8c0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.805+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 >> 172.21.15.146:0/170208951 conn(0x7fbc8c067750 msgr2=0x7fbc8c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.805+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 shutdown_connections 2024-08-17T02:29:26.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.805+0000 7fbc91e00640 1 -- 172.21.15.146:0/170208951 wait complete. 2024-08-17T02:29:26.820 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:29:26.375759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388188,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586532,"statfs":{"total":773094113280,"available":770648608768,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.852644"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:21.821589+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:29:21.821589+0000","last_peered":"2024-08-17T02:29:21.821589+0000","last_clean":"2024-08-17T02:29:21.821589+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:29:21.821589+0000","last_undegraded":"2024-08-17T02:29:21.821589+0000","last_fullsized":"2024-08-17T02:29:21.821589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.629,"15min":0.59999999999999998},"min":{"1min":0.56299999999999994,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":0.93899999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72499999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.755,"15min":0.749},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.58799999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.95799999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.23,"15min":1.23},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93000000000000005,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.435,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78100000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83499999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88300000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":1.115,"15min":1.115},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73199999999999998,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":1.135,"15min":1.135},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69199999999999995},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.86499999999999999,"5min":3.569,"15min":3.569},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":2.016,"15min":2.016},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.872,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93999999999999995,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.67900000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.67100000000000004,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92000000000000004,"5min":2.052,"15min":2.052},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.88400000000000001,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.65800000000000003,"15min":0.61199999999999999},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83899999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.91600000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":1.266,"15min":1.266},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69799999999999995,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.70599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.626}]},{"osd":4,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":1.161,"15min":1.161},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.208,"15min":1.208},"last":0.498},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":1.3,"15min":1.3},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.56699999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.746}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90400000000000003,"5min":1.623,"15min":1.623},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.62,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98899999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.621,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.661,"15min":1.661},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92400000000000004,"5min":1.758,"15min":1.758},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.44,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77700000000000002,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85399999999999998,"5min":1.087,"15min":1.087},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0129999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":3.226,"15min":3.226},"last":0.439},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.53600000000000003,"15min":0.57399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.901,"15min":1.901},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":2.75,"15min":2.75},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.081,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.94299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1020000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":1.052}]},{"osd":5,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.0580000000000001,"5min":3.581,"15min":3.581},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.153,"5min":3.157,"15min":3.157},"last":1.073}]},{"osd":6,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.117,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.91800000000000004,"15min":0.95499999999999996},"min":{"1min":0.69299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1339999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.002,"5min":3.496,"15min":3.496},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.98699999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0329999999999999,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.96999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.52300000000000002},"min":{"1min":0.32600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.624,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67600000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.907,"15min":1.907},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.77200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":5.577,"15min":5.577},"last":0.504}]},{"osd":3,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.05,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.90600000000000003},"min":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97499999999999998,"5min":3.226,"15min":3.226},"last":0.621},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94199999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.875},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.90100000000000002},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0649999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85599999999999998,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":3.028,"15min":3.028},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0780000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.621,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0149999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.94899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77100000000000002},"min":{"1min":0.59399999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.083,"15min":1.083},"last":1.054},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.024,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.95799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.40899999999999997},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.753,"15min":0.753},"last":0.438}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.505,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.498}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.96699999999999997,"5min":1.288,"15min":1.288},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":1.208,"15min":1.208},"last":0.627},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.61099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94499999999999995,"5min":1.135,"15min":1.135},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.77100000000000002},"min":{"1min":0.67300000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.95499999999999996,"5min":1.448,"15min":1.448},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96399999999999997,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:26.821 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:26.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.970+0000 7f2fc4a00640 1 Processor -- start 2024-08-17T02:29:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.971+0000 7f2fc4a00640 1 -- start start 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fc4a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc00c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fc4a00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00ae6b0 con 0x7f2fc0159c40 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fc4a00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00af230 con 0x7f2fc00addf0 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fc4a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00ae900 con 0x7f2fc00ada20 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fb5e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2fc0159c40 0x7f2fc00cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42414/0 (socket says 172.21.15.146:42414) 2024-08-17T02:29:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fb5e00640 1 -- 172.21.15.146:0/2186108354 learned_addr learned my addr 172.21.15.146:0/2186108354 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.972+0000 7f2fbe800640 1 --2- 172.21.15.146:0/2186108354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc00c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651577861 0 0) 0x7f2fc00ae6b0 con 0x7f2fc0159c40 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa40034e0 con 0x7f2fc0159c40 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941136613 0 0) 0x7f2fc00af230 con 0x7f2fc00addf0 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc00ae6b0 con 0x7f2fc00addf0 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbe800640 1 -- 172.21.15.146:0/2186108354 >> v1:172.21.15.150:6789/0 conn(0x7f2fc00addf0 legacy=0x7f2fc0154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbe800640 1 -- 172.21.15.146:0/2186108354 >> v1:172.21.15.146:6789/0 conn(0x7f2fc0159c40 legacy=0x7f2fc00cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.973+0000 7f2fbe800640 1 -- 172.21.15.146:0/2186108354 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00aebe0 con 0x7f2fc00ada20 2024-08-17T02:29:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.974+0000 7f2fbe800640 1 --2- 172.21.15.146:0/2186108354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc00c8060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000aa20 tx=0x7f2fb000a2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f33559c49be516 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.974+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0030510 con 0x7f2fc00ada20 2024-08-17T02:29:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.974+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb002e050 con 0x7f2fc00ada20 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.974+0000 7f2fbde00640 1 -- 172.21.15.146:0/2186108354 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00308a0 con 0x7f2fc00ada20 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 -- 172.21.15.146:0/2186108354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 msgr2=0x7f2fc00c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/2186108354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc00c8060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000aa20 tx=0x7f2fb000a2b0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 -- 172.21.15.146:0/2186108354 shutdown_connections 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/2186108354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc00c8060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 -- 172.21.15.146:0/2186108354 >> 172.21.15.146:0/2186108354 conn(0x7f2fc0067750 msgr2=0x7f2fc00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 -- 172.21.15.146:0/2186108354 shutdown_connections 2024-08-17T02:29:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.975+0000 7f2fc4a00640 1 -- 172.21.15.146:0/2186108354 wait complete. 2024-08-17T02:29:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.976+0000 7f2fc4a00640 1 Processor -- start 2024-08-17T02:29:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.976+0000 7f2fc4a00640 1 -- start start 2024-08-17T02:29:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc00addf0 0x7f2fc00c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01570c0 con 0x7f2fc0159c40 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01536a0 con 0x7f2fc00addf0 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.977+0000 7f2fc4a00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc0155c50 con 0x7f2fc00ada20 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbe800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51722/0 (socket says 172.21.15.146:51722) 2024-08-17T02:29:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 -- 172.21.15.146:0/3481866714 learned_addr learned my addr 172.21.15.146:0/3481866714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fb5e00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc00addf0 0x7f2fc00c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 -- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 msgr2=0x7f2fc0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 -- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc00addf0 msgr2=0x7f2fc00c1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc00addf0 0x7f2fc00c1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 -- 172.21.15.146:0/3481866714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb000a530 con 0x7f2fc0159c40 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbe800640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.978+0000 7f2fbf200640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c910 tx=0x7f2fb80026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.979+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800cea0 con 0x7f2fc0159c40 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.979+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800a850 con 0x7f2fc0159c40 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.979+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800ac70 con 0x7f2fc0159c40 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.979+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0155f30 con 0x7f2fc0159c40 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.979+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc01564f0 con 0x7f2fc0159c40 2024-08-17T02:29:26.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.980+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc0157270 con 0x7f2fc0159c40 2024-08-17T02:29:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.981+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fb8012630 con 0x7f2fc0159c40 2024-08-17T02:29:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.981+0000 7f2fb6a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 0x7f2f9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.981+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2fb8082400 con 0x7f2fc0159c40 2024-08-17T02:29:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.982+0000 7f2fbe800640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 0x7f2f9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.982+0000 7f2fbe800640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 0x7f2f9c067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0035000 tx=0x7f2fb0038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:26.986+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2fc0157270 con 0x7f2fc0159c40 2024-08-17T02:29:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.154+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fc0071050 con 0x7f2f9c065150 2024-08-17T02:29:27.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.156+0000 7f2fb6a00640 1 -- 172.21.15.146:0/3481866714 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50543 (secure 0 0 0) 0x7f2fc0071050 con 0x7f2f9c065150 2024-08-17T02:29:27.157 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 msgr2=0x7f2f9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 0x7f2f9c067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0035000 tx=0x7f2fb0038000 comp rx=0 tx=0).stop 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 msgr2=0x7f2fc00c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c910 tx=0x7f2fb80026f0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 shutdown_connections 2024-08-17T02:29:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f2f9c065150 0x7f2f9c067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fc0159c40 0x7f2fc00c1890 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.158+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc00addf0 0x7f2fc00c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.159+0000 7f2fc4a00640 1 --2- 172.21.15.146:0/3481866714 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fc00ada20 0x7f2fc0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.159+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 >> 172.21.15.146:0/3481866714 conn(0x7f2fc0067750 msgr2=0x7f2fc0069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.159+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 shutdown_connections 2024-08-17T02:29:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.159+0000 7f2fc4a00640 1 -- 172.21.15.146:0/3481866714 wait complete. 2024-08-17T02:29:27.174 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:29:26.375759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388188,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586532,"statfs":{"total":773094113280,"available":770648608768,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.852644"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:21.821589+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:29:21.821589+0000","last_peered":"2024-08-17T02:29:21.821589+0000","last_clean":"2024-08-17T02:29:21.821589+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:29:21.821589+0000","last_undegraded":"2024-08-17T02:29:21.821589+0000","last_fullsized":"2024-08-17T02:29:21.821589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.629,"15min":0.59999999999999998},"min":{"1min":0.56299999999999994,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":0.93899999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72499999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.755,"15min":0.749},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.58799999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.95799999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.23,"15min":1.23},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93000000000000005,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.97199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.435,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78100000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83499999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88300000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":1.115,"15min":1.115},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73199999999999998,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":1.135,"15min":1.135},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69199999999999995},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.86499999999999999,"5min":3.569,"15min":3.569},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":2.016,"15min":2.016},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.872,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93999999999999995,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.67900000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.65300000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.67100000000000004,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92000000000000004,"5min":2.052,"15min":2.052},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.88400000000000001,"5min":1.607,"15min":1.607},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.74399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.65800000000000003,"15min":0.61199999999999999},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83899999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.91600000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":1.266,"15min":1.266},"last":0.54900000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69799999999999995,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.70599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.626}]},{"osd":4,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":1.161,"15min":1.161},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.208,"15min":1.208},"last":0.498},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":1.3,"15min":1.3},"last":0.53900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.56699999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.746}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90400000000000003,"5min":1.623,"15min":1.623},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.63}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.62,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98899999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.621,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.661,"15min":1.661},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92400000000000004,"5min":1.758,"15min":1.758},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.44,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77700000000000002,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85399999999999998,"5min":1.087,"15min":1.087},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0129999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":3.226,"15min":3.226},"last":0.439},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.53600000000000003,"15min":0.57399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.901,"15min":1.901},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":2.75,"15min":2.75},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.081,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.94299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1020000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":1.052}]},{"osd":5,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.0580000000000001,"5min":3.581,"15min":3.581},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.153,"5min":3.157,"15min":3.157},"last":1.073}]},{"osd":6,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.117,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.91800000000000004,"15min":0.95499999999999996},"min":{"1min":0.69299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1339999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.002,"5min":3.496,"15min":3.496},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.98699999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0329999999999999,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.96999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.52300000000000002},"min":{"1min":0.32600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.624,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67600000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.907,"15min":1.907},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.77200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":5.577,"15min":5.577},"last":0.504}]},{"osd":3,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.05,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.90600000000000003},"min":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97499999999999998,"5min":3.226,"15min":3.226},"last":0.621},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94199999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.875},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.90100000000000002},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0649999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85599999999999998,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":3.028,"15min":3.028},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0780000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.621,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0149999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.88300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.872},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.94899999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77100000000000002},"min":{"1min":0.59399999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.083,"15min":1.083},"last":1.054},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.89500000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.024,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.95799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.317},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.40899999999999997},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.753,"15min":0.753},"last":0.438}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.505,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.498}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.96699999999999997,"5min":1.288,"15min":1.288},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":1.208,"15min":1.208},"last":0.627},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.61099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94499999999999995,"5min":1.135,"15min":1.135},"last":0.58799999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.77100000000000002},"min":{"1min":0.67300000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.95499999999999996,"5min":1.448,"15min":1.448},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96399999999999997,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:27.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.324+0000 7f00b6000640 1 Processor -- start 2024-08-17T02:29:27.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.324+0000 7f00b6000640 1 -- start start 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00b6000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f00b00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00b6000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0156670 con 0x7f00b006df00 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00b6000640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b006e5e0 con 0x7f00b0155a20 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00b6000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b0350 con 0x7f00b0155df0 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00a6a00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f00b006df00 0x7f00b0156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42428/0 (socket says 172.21.15.146:42428) 2024-08-17T02:29:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00a6a00640 1 -- 172.21.15.146:0/3449499169 learned_addr learned my addr 172.21.15.146:0/3449499169 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00afe00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f00b00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944404799 0 0) 0x7f00b0156670 con 0x7f00b006df00 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.326+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00940034e0 con 0x7f00b006df00 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033131530 0 0) 0x7f00b006e5e0 con 0x7f00b0155a20 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b0156670 con 0x7f00b0155a20 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2857851481 0 0) 0x7f00940034e0 con 0x7f00b006df00 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 msgr2=0x7f00b00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f00b00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 >> v1:172.21.15.150:6789/0 conn(0x7f00b0155a20 legacy=0x7f00b006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b006e8c0 con 0x7f00b006df00 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f0098001470 con 0x7f00b006df00 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 >> v1:172.21.15.146:6789/0 conn(0x7f00b006df00 legacy=0x7f00b0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f0094003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00940040d0 0x7f0094004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0094004cc0 0x7f0094005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009400ffe0 con 0x7f0094004cc0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094010120 con 0x7f00940040d0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094010290 con 0x7f00b0155df0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0094004cc0 0x7f0094005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00af400640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f0094003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00a6a00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00940040d0 0x7f0094004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 -- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 msgr2=0x7f0094003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f0094003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 -- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00940040d0 msgr2=0x7f0094004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00940040d0 0x7f0094004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00afe00640 1 -- 172.21.15.146:0/3449499169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940034e0 con 0x7f0094004cc0 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00a6a00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00940040d0 0x7f0094004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.327+0000 7f00af400640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b0155df0 0x7f0094003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.328+0000 7f00afe00640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0094004cc0 0x7f0094005130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f00b0156230 tx=0x7f00a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dc08f0f22f3b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8031420 con 0x7f0094004cc0 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800f040 con 0x7f0094004cc0 2024-08-17T02:29:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00aea00640 1 -- 172.21.15.146:0/3449499169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80317b0 con 0x7f0094004cc0 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 -- 172.21.15.146:0/3449499169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0094004cc0 msgr2=0x7f0094005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 --2- 172.21.15.146:0/3449499169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0094004cc0 0x7f0094005130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f00b0156230 tx=0x7f00a800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00afe00640 1 -- 172.21.15.146:0/3449499169 reap_dead start 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 -- 172.21.15.146:0/3449499169 shutdown_connections 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 -- 172.21.15.146:0/3449499169 >> 172.21.15.146:0/3449499169 conn(0x7f00b00cb9b0 msgr2=0x7f00b00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 -- 172.21.15.146:0/3449499169 shutdown_connections 2024-08-17T02:29:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.329+0000 7f00b6000640 1 -- 172.21.15.146:0/3449499169 wait complete. 2024-08-17T02:29:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.331+0000 7f00b6000640 1 Processor -- start 2024-08-17T02:29:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.331+0000 7f00b6000640 1 -- start start 2024-08-17T02:29:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 0x7f00b013d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b00aa9b0 0x7f00b0167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00a6d40 con 0x7f00b00a7a80 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b013dc20 con 0x7f0094004cc0 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00b6000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00aae20 con 0x7f00b00aa9b0 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51736/0 (socket says 172.21.15.146:51736) 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 -- 172.21.15.146:0/3108893087 learned_addr learned my addr 172.21.15.146:0/3108893087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00afe00640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b00aa9b0 0x7f00b0167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00af400640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 0x7f00b013d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 -- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b00aa9b0 msgr2=0x7f00b0167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b00aa9b0 0x7f00b0167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 -- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 msgr2=0x7f00b013d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 0x7f00b013d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00a6a00640 1 -- 172.21.15.146:0/3108893087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00a5e90 con 0x7f00b00a7a80 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.332+0000 7f00af400640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 0x7f00b013d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00a6a00640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f009800ebc0 tx=0x7f0098000cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800c8d0 con 0x7f00b00a7a80 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009800ca30 con 0x7f00b00a7a80 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00a6130 con 0x7f00b00a7a80 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800cdf0 con 0x7f00b00a7a80 2024-08-17T02:29:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.333+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b00a66f0 con 0x7f00b00a7a80 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.334+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00a6ef0 con 0x7f00b00a7a80 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.335+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0098013630 con 0x7f00b00a7a80 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.335+0000 7f00a7400640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 0x7f008c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.336+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f00980821d0 con 0x7f00b00a7a80 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.336+0000 7f00af400640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 0x7f008c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.336+0000 7f00af400640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 0x7f008c067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000f60 tx=0x7f00a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.340+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00b00a6ef0 con 0x7f00b00a7a80 2024-08-17T02:29:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.514+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00b0064db0 con 0x7f00b00a7a80 2024-08-17T02:29:27.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.515+0000 7f00a7400640 1 -- 172.21.15.146:0/3108893087 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f0098050490 con 0x7f00b00a7a80 2024-08-17T02:29:27.516 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:27.516 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":43,"fsid":"955175c7-decf-4b1d-aa3f-b20724739e7d","created":"2024-08-17T02:25:37.862781+0000","modified":"2024-08-17T02:29:22.816626+0000","last_up_change":"2024-08-17T02:25:49.487674+0000","last_in_change":"2024-08-17T02:25:40.623341+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:50.375100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c203653f-41d3-49d2-809b-9475340eb13a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":37113},{"type":"v1","addr":"172.21.15.146:6809","nonce":37113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":37113},{"type":"v1","addr":"172.21.15.146:6811","nonce":37113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":37113},{"type":"v1","addr":"172.21.15.146:6815","nonce":37113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":37113},{"type":"v1","addr":"172.21.15.146:6813","nonce":37113}]},"public_addr":"172.21.15.146:6809/37113","cluster_addr":"172.21.15.146:6811/37113","heartbeat_back_addr":"172.21.15.146:6815/37113","heartbeat_front_addr":"172.21.15.146:6813/37113","state":["exists","up"]},{"osd":1,"uuid":"8cc3b7ae-3662-4943-b073-9f77001ed5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":37112},{"type":"v1","addr":"172.21.15.146:6801","nonce":37112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":37112},{"type":"v1","addr":"172.21.15.146:6803","nonce":37112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":37112},{"type":"v1","addr":"172.21.15.146:6807","nonce":37112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":37112},{"type":"v1","addr":"172.21.15.146:6805","nonce":37112}]},"public_addr":"172.21.15.146:6801/37112","cluster_addr":"172.21.15.146:6803/37112","heartbeat_back_addr":"172.21.15.146:6807/37112","heartbeat_front_addr":"172.21.15.146:6805/37112","state":["exists","up"]},{"osd":2,"uuid":"685a41c6-c583-4ca3-a279-b7b9c74fba7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":37117},{"type":"v1","addr":"172.21.15.146:6817","nonce":37117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":37117},{"type":"v1","addr":"172.21.15.146:6819","nonce":37117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":37117},{"type":"v1","addr":"172.21.15.146:6823","nonce":37117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":37117},{"type":"v1","addr":"172.21.15.146:6821","nonce":37117}]},"public_addr":"172.21.15.146:6817/37117","cluster_addr":"172.21.15.146:6819/37117","heartbeat_back_addr":"172.21.15.146:6823/37117","heartbeat_front_addr":"172.21.15.146:6821/37117","state":["exists","up"]},{"osd":3,"uuid":"a81ab657-5c27-4d75-b42f-d35337c645ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":37127},{"type":"v1","addr":"172.21.15.146:6825","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":37127},{"type":"v1","addr":"172.21.15.146:6827","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":37127},{"type":"v1","addr":"172.21.15.146:6831","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":37127},{"type":"v1","addr":"172.21.15.146:6829","nonce":37127}]},"public_addr":"172.21.15.146:6825/37127","cluster_addr":"172.21.15.146:6827/37127","heartbeat_back_addr":"172.21.15.146:6831/37127","heartbeat_front_addr":"172.21.15.146:6829/37127","state":["exists","up"]},{"osd":4,"uuid":"cfadd5f1-8a8a-4714-bf1f-faadd7fe6fb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":37541},{"type":"v1","addr":"172.21.15.150:6809","nonce":37541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":37541},{"type":"v1","addr":"172.21.15.150:6811","nonce":37541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":37541},{"type":"v1","addr":"172.21.15.150:6815","nonce":37541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":37541},{"type":"v1","addr":"172.21.15.150:6813","nonce":37541}]},"public_addr":"172.21.15.150:6809/37541","cluster_addr":"172.21.15.150:6811/37541","heartbeat_back_addr":"172.21.15.150:6815/37541","heartbeat_front_addr":"172.21.15.150:6813/37541","state":["exists","up"]},{"osd":5,"uuid":"30780f03-2e7f-47ac-9713-af35f283e12b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":37542},{"type":"v1","addr":"172.21.15.150:6825","nonce":37542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":37542},{"type":"v1","addr":"172.21.15.150:6827","nonce":37542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":37542},{"type":"v1","addr":"172.21.15.150:6831","nonce":37542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":37542},{"type":"v1","addr":"172.21.15.150:6829","nonce":37542}]},"public_addr":"172.21.15.150:6825/37542","cluster_addr":"172.21.15.150:6827/37542","heartbeat_back_addr":"172.21.15.150:6831/37542","heartbeat_front_addr":"172.21.15.150:6829/37542","state":["exists","up"]},{"osd":6,"uuid":"2a34e0eb-8c44-4bf6-aa4e-0462ae778110","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":37543},{"type":"v1","addr":"172.21.15.150:6817","nonce":37543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":37543},{"type":"v1","addr":"172.21.15.150:6819","nonce":37543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":37543},{"type":"v1","addr":"172.21.15.150:6823","nonce":37543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":37543},{"type":"v1","addr":"172.21.15.150:6821","nonce":37543}]},"public_addr":"172.21.15.150:6817/37543","cluster_addr":"172.21.15.150:6819/37543","heartbeat_back_addr":"172.21.15.150:6823/37543","heartbeat_front_addr":"172.21.15.150:6821/37543","state":["exists","up"]},{"osd":7,"uuid":"3d68d8c4-565a-4b04-8d1b-7bb663bafa5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":37540},{"type":"v1","addr":"172.21.15.150:6801","nonce":37540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":37540},{"type":"v1","addr":"172.21.15.150:6803","nonce":37540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":37540},{"type":"v1","addr":"172.21.15.150:6807","nonce":37540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":37540},{"type":"v1","addr":"172.21.15.150:6805","nonce":37540}]},"public_addr":"172.21.15.150:6801/37540","cluster_addr":"172.21.15.150:6803/37540","heartbeat_back_addr":"172.21.15.150:6807/37540","heartbeat_front_addr":"172.21.15.150:6805/37540","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.882829+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:46.009767+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.957573+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.968969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.954946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.975598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:25:45.863572+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6835/414928528":"2024-08-18T02:29:19.520343+0000","172.21.15.150:6833/414928528":"2024-08-18T02:29:19.520343+0000","172.21.15.146:6835/4020030705":"2024-08-18T02:29:12.767829+0000","172.21.15.146:6834/4020030705":"2024-08-18T02:29:12.767829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 msgr2=0x7f008c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 0x7f008c067630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000f60 tx=0x7f00a0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 msgr2=0x7f00b00aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f009800ebc0 tx=0x7f0098000cc0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 shutdown_connections 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f008c065180 0x7f008c067630 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00b00a7a80 0x7f00b00aa470 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00b00aa9b0 0x7f00b0167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 --2- 172.21.15.146:0/3108893087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0094004cc0 0x7f00b013d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 >> 172.21.15.146:0/3108893087 conn(0x7f00b00cb9b0 msgr2=0x7f00b0154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 shutdown_connections 2024-08-17T02:29:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:27.517+0000 7f00b6000640 1 -- 172.21.15.146:0/3108893087 wait complete. 2024-08-17T02:29:28.533 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:29:28.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.699+0000 7f33ba600640 1 Processor -- start 2024-08-17T02:29:28.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.699+0000 7f33ba600640 1 -- start start 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33ba600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33b41561c0 0x7f33b40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33ba600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b4156910 con 0x7f33b4152d80 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33ba600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b40cb580 con 0x7f33b40aca60 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33ba600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b4156640 con 0x7f33b41561c0 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33b3400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f33b4152d80 0x7f33b406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42432/0 (socket says 172.21.15.146:42432) 2024-08-17T02:29:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33b3400640 1 -- 172.21.15.146:0/1912950207 learned_addr learned my addr 172.21.15.146:0/1912950207 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33aaa00640 1 --2- 172.21.15.146:0/1912950207 >> v2:172.21.15.150:3300/0 conn(0x7f33b41561c0 0x7f33b40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782608077 0 0) 0x7f33b4156910 con 0x7f33b4152d80 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.701+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33980034e0 con 0x7f33b4152d80 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803555126 0 0) 0x7f33980034e0 con 0x7f33b4152d80 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 >> v2:172.21.15.150:3300/0 conn(0x7f33b41561c0 msgr2=0x7f33b40cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 --2- 172.21.15.146:0/1912950207 >> v2:172.21.15.150:3300/0 conn(0x7f33b41561c0 0x7f33b40cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 >> v1:172.21.15.150:6789/0 conn(0x7f33b40aca60 legacy=0x7f33b40ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4153150 con 0x7f33b4152d80 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f33a4001470 con 0x7f33b4152d80 2024-08-17T02:29:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 >> v1:172.21.15.146:6789/0 conn(0x7f33b4152d80 legacy=0x7f33b406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33980039d0 0x7f3398003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398004780 0x7f3398004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 0x7f339800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4156640 con 0x7f3398005130 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339800bfc0 con 0x7f33980039d0 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339800c180 con 0x7f3398004780 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b3e00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 0x7f339800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33b3400640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33980039d0 0x7f3398003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.702+0000 7f33aaa00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398004780 0x7f3398004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 -- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398004780 msgr2=0x7f3398004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398004780 0x7f3398004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 -- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33980039d0 msgr2=0x7f3398003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33980039d0 0x7f3398003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 -- 172.21.15.146:0/1912950207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980034e0 con 0x7f3398005130 2024-08-17T02:29:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.703+0000 7f33b3e00640 1 -- 172.21.15.146:0/1912950207 reap_dead start 2024-08-17T02:29:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33b3e00640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 0x7f339800b9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001fe0 tx=0x7f33ac001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d8c28834368684 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac031440 con 0x7f3398005130 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac02d050 con 0x7f3398005130 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33b2a00640 1 -- 172.21.15.146:0/1912950207 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac031810 con 0x7f3398005130 2024-08-17T02:29:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33ba600640 1 -- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 msgr2=0x7f339800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33ba600640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 0x7f339800b9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001fe0 tx=0x7f33ac001640 comp rx=0 tx=0).stop 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33ba600640 1 -- 172.21.15.146:0/1912950207 shutdown_connections 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33ba600640 1 --2- 172.21.15.146:0/1912950207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3398005130 0x7f339800b9d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.704+0000 7f33ba600640 1 -- 172.21.15.146:0/1912950207 >> 172.21.15.146:0/1912950207 conn(0x7f33b4067750 msgr2=0x7f33b406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.705+0000 7f33ba600640 1 -- 172.21.15.146:0/1912950207 shutdown_connections 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.705+0000 7f33ba600640 1 -- 172.21.15.146:0/1912950207 wait complete. 2024-08-17T02:29:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.706+0000 7f33ba600640 1 Processor -- start 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.706+0000 7f33ba600640 1 -- start start 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398005130 0x7f33b416ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b41596d0 0x7f33b41463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 0x7f33b40ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4157930 con 0x7f33b40aae00 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b416d9a0 con 0x7f33b41596d0 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33ba600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b416d100 con 0x7f3398005130 2024-08-17T02:29:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33b3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 0x7f33b40ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33b3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 0x7f33b40ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51746/0 (socket says 172.21.15.146:51746) 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33b3e00640 1 -- 172.21.15.146:0/507825209 learned_addr learned my addr 172.21.15.146:0/507825209 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33b3400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398005130 0x7f33b416ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33aaa00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b41596d0 0x7f33b41463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.707+0000 7f33b3e00640 1 -- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398005130 msgr2=0x7f33b416ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3e00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398005130 0x7f33b416ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3e00640 1 -- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b41596d0 msgr2=0x7f33b41463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3e00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33b41596d0 0x7f33b41463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3e00640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b416d3e0 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3398005130 0x7f33b416ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33b3e00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 0x7f33b40ab250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001a40 tx=0x7f33ac034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac006d20 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac006e80 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac007260 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b416d6c0 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.708+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b4146900 con 0x7f33b40aae00 2024-08-17T02:29:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.709+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33b40710c0 con 0x7f33b40aae00 2024-08-17T02:29:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.710+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f33ac007650 con 0x7f33b40aae00 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33ab400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3390065180 0x7f3390067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f33ac0a2070 con 0x7f33b40aae00 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33ab400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f339006b070 0x7f339006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33b3400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3390065180 0x7f3390067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f339006db30 con 0x7f339006b070 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ac0a4570 con 0x7f33b40aae00 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.711+0000 7f33aaa00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f339006b070 0x7f339006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.712+0000 7f33b3400640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3390065180 0x7f3390067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000e10 tx=0x7f33a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.712+0000 7f33aaa00640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f339006b070 0x7f339006d480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.712+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== osd.0 v2:172.21.15.146:6808/37113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f339006db30 con 0x7f339006b070 2024-08-17T02:29:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.725+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 --> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33b40c8450 con 0x7f339006b070 2024-08-17T02:29:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.725+0000 7f33ab400640 1 -- 172.21.15.146:0/507825209 <== osd.0 v2:172.21.15.146:6808/37113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f33b40c8450 con 0x7f339006b070 2024-08-17T02:29:28.726 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:28.726 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:28.726 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f339006b070 msgr2=0x7f339006d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6808/37113,v1:172.21.15.146:6809/37113] conn(0x7f339006b070 0x7f339006d480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3390065180 msgr2=0x7f3390067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f3390065180 0x7f3390067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33a4000e10 tx=0x7f33a4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 msgr2=0x7f33b40ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 --2- 172.21.15.146:0/507825209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33b40aae00 0x7f33b40ab250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001a40 tx=0x7f33ac034000 comp rx=0 tx=0).stop 2024-08-17T02:29:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33b3e00640 1 -- 172.21.15.146:0/507825209 reap_dead start 2024-08-17T02:29:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 shutdown_connections 2024-08-17T02:29:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 >> 172.21.15.146:0/507825209 conn(0x7f33b4067750 msgr2=0x7f33b40ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 shutdown_connections 2024-08-17T02:29:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.726+0000 7f33ba600640 1 -- 172.21.15.146:0/507825209 wait complete. 2024-08-17T02:29:28.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:29:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.894+0000 7f0806600640 1 Processor -- start 2024-08-17T02:29:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.894+0000 7f0806600640 1 -- start start 2024-08-17T02:29:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.895+0000 7f0806600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0800155180 0x7f08000aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.895+0000 7f0806600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f08000ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.895+0000 7f0806600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000afc10 con 0x7f080006e080 2024-08-17T02:29:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.895+0000 7f0806600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000ae5b0 con 0x7f0800155180 2024-08-17T02:29:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.896+0000 7f0806600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000af000 con 0x7f0800155550 2024-08-17T02:29:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.896+0000 7f07f7e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f08000ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.896+0000 7f07ffe00640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f080006e080 0x7f080006e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:38578/0 (socket says 172.21.15.146:38578) 2024-08-17T02:29:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.896+0000 7f07ffe00640 1 -- 172.21.15.146:0/1978819112 learned_addr learned my addr 172.21.15.146:0/1978819112 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.896+0000 7f07ff400640 1 --2- 172.21.15.146:0/1978819112 >> v2:172.21.15.150:3300/0 conn(0x7f0800155180 0x7f08000aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07ff400640 1 -- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 msgr2=0x7f08000ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07ff400640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f08000ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07ff400640 1 -- 172.21.15.146:0/1978819112 >> v1:172.21.15.150:6789/0 conn(0x7f080006e080 legacy=0x7f080006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07ff400640 1 -- 172.21.15.146:0/1978819112 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000af2e0 con 0x7f0800155180 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07f7e00640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f08000ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.897+0000 7f07fea00640 1 -- 172.21.15.146:0/1978819112 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138883320 0 0) 0x7f08000afc10 con 0x7f080006e080 2024-08-17T02:29:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.898+0000 7f07ff400640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800155180 0x7f08000aea20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009850 tx=0x7f07f00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d779942d800484e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.898+0000 7f07fea00640 1 -- 172.21.15.146:0/1978819112 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f002ad80 con 0x7f0800155180 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.898+0000 7f07fea00640 1 -- 172.21.15.146:0/1978819112 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0032440 con 0x7f0800155180 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.898+0000 7f07fea00640 1 -- 172.21.15.146:0/1978819112 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00327e0 con 0x7f0800155180 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 -- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800155180 msgr2=0x7f08000aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800155180 0x7f08000aea20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009850 tx=0x7f07f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 -- 172.21.15.146:0/1978819112 shutdown_connections 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f08000ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 --2- 172.21.15.146:0/1978819112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0800155180 0x7f08000aea20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 -- 172.21.15.146:0/1978819112 >> 172.21.15.146:0/1978819112 conn(0x7f08000cb9b0 msgr2=0x7f08000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 -- 172.21.15.146:0/1978819112 shutdown_connections 2024-08-17T02:29:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.899+0000 7f0806600640 1 -- 172.21.15.146:0/1978819112 wait complete. 2024-08-17T02:29:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.900+0000 7f0806600640 1 Processor -- start 2024-08-17T02:29:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.900+0000 7f0806600640 1 -- start start 2024-08-17T02:29:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f080006e080 0x7f08000c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f080006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800156580 con 0x7f0800155180 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800156860 con 0x7f080006e080 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f0806600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0800156b40 con 0x7f0800155550 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f07f7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f07f7e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51758/0 (socket says 172.21.15.146:51758) 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f07f7e00640 1 -- 172.21.15.146:0/236169587 learned_addr learned my addr 172.21.15.146:0/236169587 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f07ff400640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f080006e080 0x7f08000c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.901+0000 7f07ffe00640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f080006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 -- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 msgr2=0x7f080006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f080006c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 -- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f080006e080 msgr2=0x7f08000c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f080006e080 0x7f08000c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 -- 172.21.15.146:0/236169587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009390 con 0x7f0800155180 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f7e00640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f07e800ea70 tx=0x7f07e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800ca10 con 0x7f0800155180 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800cb70 con 0x7f0800155180 2024-08-17T02:29:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8013470 con 0x7f0800155180 2024-08-17T02:29:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0009390 con 0x7f0800155180 2024-08-17T02:29:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.902+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0800157100 con 0x7f0800155180 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.903+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800064db0 con 0x7f0800155180 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.904+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f07e8013820 con 0x7f0800155180 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.905+0000 7f07f6a00640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 0x7f07dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.905+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f07e80824c0 con 0x7f0800155180 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.906+0000 7f07ff400640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 0x7f07dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.906+0000 7f07ff400640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 0x7f07dc067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f07f0034000 tx=0x7f07f0032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:28.910+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f07e8050830 con 0x7f0800155180 2024-08-17T02:29:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.083+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f080006d5c0 con 0x7f07dc065150 2024-08-17T02:29:29.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.083+0000 7f07f6a00640 1 -- 172.21.15.146:0/236169587 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f080006d5c0 con 0x7f07dc065150 2024-08-17T02:29:29.084 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:29:29.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 msgr2=0x7f07dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 0x7f07dc067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f07f0034000 tx=0x7f07f0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 msgr2=0x7f0800151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f07e800ea70 tx=0x7f07e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 shutdown_connections 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f07dc065150 0x7f07dc067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0800155180 0x7f0800151580 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0800155550 0x7f080006c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 --2- 172.21.15.146:0/236169587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f080006e080 0x7f08000c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 >> 172.21.15.146:0/236169587 conn(0x7f08000cb9b0 msgr2=0x7f080006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 shutdown_connections 2024-08-17T02:29:29.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.086+0000 7f0806600640 1 -- 172.21.15.146:0/236169587 wait complete. 2024-08-17T02:29:29.102 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:29:29.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:29.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.255+0000 7f979d600640 1 Processor -- start 2024-08-17T02:29:29.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.255+0000 7f979d600640 1 -- start start 2024-08-17T02:29:29.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f979d600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f979806e5f0 0x7f97980c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f979d600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980ae9b0 con 0x7f9798156c60 2024-08-17T02:29:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f979d600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980ab320 con 0x7f9798156890 2024-08-17T02:29:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f979d600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980aa730 con 0x7f979806e5f0 2024-08-17T02:29:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f9797400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9798156c60 0x7f97980ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42440/0 (socket says 172.21.15.146:42440) 2024-08-17T02:29:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.256+0000 7f9797400640 1 -- 172.21.15.146:0/1828381069 learned_addr learned my addr 172.21.15.146:0/1828381069 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9796000640 1 --2- 172.21.15.146:0/1828381069 >> v2:172.21.15.150:3300/0 conn(0x7f979806e5f0 0x7f97980c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827959874 0 0) 0x7f97980ae9b0 con 0x7f9798156c60 2024-08-17T02:29:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f977c0034e0 con 0x7f9798156c60 2024-08-17T02:29:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158987732 0 0) 0x7f97980ab320 con 0x7f9798156890 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97980ae9b0 con 0x7f9798156890 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9796000640 1 -- 172.21.15.146:0/1828381069 >> v1:172.21.15.150:6789/0 conn(0x7f9798156890 legacy=0x7f979806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9796000640 1 -- 172.21.15.146:0/1828381069 >> v1:172.21.15.146:6789/0 conn(0x7f9798156c60 legacy=0x7f97980ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 228909793 0 0) 0x7f977c0034e0 con 0x7f9798156c60 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.257+0000 7f9796000640 1 -- 172.21.15.146:0/1828381069 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980aa9f0 con 0x7f979806e5f0 2024-08-17T02:29:29.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.258+0000 7f9796000640 1 --2- 172.21.15.146:0/1828381069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f97980c8130 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9784009850 tx=0x7f97840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a05b3f330bd644c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978402ad90 con 0x7f979806e5f0 2024-08-17T02:29:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784032440 con 0x7f979806e5f0 2024-08-17T02:29:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f9795600640 1 -- 172.21.15.146:0/1828381069 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840327e0 con 0x7f979806e5f0 2024-08-17T02:29:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 -- 172.21.15.146:0/1828381069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 msgr2=0x7f97980c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 --2- 172.21.15.146:0/1828381069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f97980c8130 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9784009850 tx=0x7f97840090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 -- 172.21.15.146:0/1828381069 shutdown_connections 2024-08-17T02:29:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 --2- 172.21.15.146:0/1828381069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f97980c8130 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 -- 172.21.15.146:0/1828381069 >> 172.21.15.146:0/1828381069 conn(0x7f9798067750 msgr2=0x7f979806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 -- 172.21.15.146:0/1828381069 shutdown_connections 2024-08-17T02:29:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.259+0000 7f979d600640 1 -- 172.21.15.146:0/1828381069 wait complete. 2024-08-17T02:29:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.261+0000 7f979d600640 1 Processor -- start 2024-08-17T02:29:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.261+0000 7f979d600640 1 -- start start 2024-08-17T02:29:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f979815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 0x7f979813c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9798156c60 0x7f979806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979815cf60 con 0x7f9798156890 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979815d240 con 0x7f979806e5f0 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f979d600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979815d520 con 0x7f9798156c60 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 0x7f979813c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 0x7f979813c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51772/0 (socket says 172.21.15.146:51772) 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 -- 172.21.15.146:0/2874338344 learned_addr learned my addr 172.21.15.146:0/2874338344 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796a00640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f979815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9797400640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9798156c60 0x7f979806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 -- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9798156c60 msgr2=0x7f979806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9798156c60 0x7f979806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 -- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 msgr2=0x7f979815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f979815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796000640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009390 con 0x7f9798156890 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.262+0000 7f9796a00640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f979806e5f0 0x7f979815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:29.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f9796000640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 0x7f979813c0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9784009360 tx=0x7f9784032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031880 con 0x7f9798156890 2024-08-17T02:29:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840319e0 con 0x7f9798156890 2024-08-17T02:29:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031da0 con 0x7f9798156890 2024-08-17T02:29:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979815d800 con 0x7f9798156890 2024-08-17T02:29:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.263+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979815e540 con 0x7f9798156890 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.264+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97980710c0 con 0x7f9798156890 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.265+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9784039040 con 0x7f9798156890 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f978e000640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9778065150 0x7f9778067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f97840a1c60 con 0x7f9798156890 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f9796a00640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9778065150 0x7f9778067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f978e000640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f977806b040 0x7f977806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977806db00 con 0x7f977806b040 2024-08-17T02:29:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97840a4240 con 0x7f9798156890 2024-08-17T02:29:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.266+0000 7f9797400640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f977806b040 0x7f977806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.267+0000 7f9796a00640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9778065150 0x7f9778067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f979815e940 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.267+0000 7f9797400640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f977806b040 0x7f977806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.268+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== osd.1 v2:172.21.15.146:6800/37112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f977806db00 con 0x7f977806b040 2024-08-17T02:29:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.280+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 --> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97980c8b30 con 0x7f977806b040 2024-08-17T02:29:29.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f978e000640 1 -- 172.21.15.146:0/2874338344 <== osd.1 v2:172.21.15.146:6800/37112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f97980c8b30 con 0x7f977806b040 2024-08-17T02:29:29.281 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:29.281 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:29.282 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f977806b040 msgr2=0x7f977806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6800/37112,v1:172.21.15.146:6801/37112] conn(0x7f977806b040 0x7f977806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9778065150 msgr2=0x7f9778067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9778065150 0x7f9778067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f979815e940 tx=0x7f9788009040 comp rx=0 tx=0).stop 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 msgr2=0x7f979813c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 --2- 172.21.15.146:0/2874338344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9798156890 0x7f979813c0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9784009360 tx=0x7f9784032000 comp rx=0 tx=0).stop 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f9797400640 1 -- 172.21.15.146:0/2874338344 reap_dead start 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 shutdown_connections 2024-08-17T02:29:29.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.281+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 >> 172.21.15.146:0/2874338344 conn(0x7f9798067750 msgr2=0x7f9798154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.282+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 shutdown_connections 2024-08-17T02:29:29.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.282+0000 7f979d600640 1 -- 172.21.15.146:0/2874338344 wait complete. 2024-08-17T02:29:29.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:29:29.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.447+0000 7ffb93400640 1 Processor -- start 2024-08-17T02:29:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.448+0000 7ffb93400640 1 -- start start 2024-08-17T02:29:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb93400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb8c0b1440 0x7ffb8c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb93400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0caa80 con 0x7ffb8c1401b0 2024-08-17T02:29:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb93400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0c9e70 con 0x7ffb8c140580 2024-08-17T02:29:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb93400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cb450 con 0x7ffb8c0b1440 2024-08-17T02:29:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb83e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb8c0b1440 0x7ffb8c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb83e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb8c0b1440 0x7ffb8c0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51784/0 (socket says 172.21.15.146:51784) 2024-08-17T02:29:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb83e00640 1 -- 172.21.15.146:0/554020099 learned_addr learned my addr 172.21.15.146:0/554020099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.449+0000 7ffb83e00640 1 -- 172.21.15.146:0/554020099 >> v1:172.21.15.150:6789/0 conn(0x7ffb8c140580 legacy=0x7ffb8c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.450+0000 7ffb83e00640 1 -- 172.21.15.146:0/554020099 >> v1:172.21.15.146:6789/0 conn(0x7ffb8c1401b0 legacy=0x7ffb8c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.450+0000 7ffb83e00640 1 -- 172.21.15.146:0/554020099 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0ca150 con 0x7ffb8c0b1440 2024-08-17T02:29:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.450+0000 7ffb8be00640 1 -- 172.21.15.146:0/554020099 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970925982 0 0) 0x7ffb8c0caa80 con 0x7ffb8c1401b0 2024-08-17T02:29:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb83e00640 1 --2- 172.21.15.146:0/554020099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c0b1440 0x7ffb8c0caf10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009910 tx=0x7ffb740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee547ad99f4c95f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb8be00640 1 -- 172.21.15.146:0/554020099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7402ae60 con 0x7ffb8c0b1440 2024-08-17T02:29:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb8be00640 1 -- 172.21.15.146:0/554020099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74032440 con 0x7ffb8c0b1440 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb8be00640 1 -- 172.21.15.146:0/554020099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740327e0 con 0x7ffb8c0b1440 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb93400640 1 -- 172.21.15.146:0/554020099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c0b1440 msgr2=0x7ffb8c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb93400640 1 --2- 172.21.15.146:0/554020099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c0b1440 0x7ffb8c0caf10 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009910 tx=0x7ffb740091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb93400640 1 -- 172.21.15.146:0/554020099 shutdown_connections 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb93400640 1 --2- 172.21.15.146:0/554020099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c0b1440 0x7ffb8c0caf10 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.451+0000 7ffb93400640 1 -- 172.21.15.146:0/554020099 >> 172.21.15.146:0/554020099 conn(0x7ffb8c0cb9b0 msgr2=0x7ffb8c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.452+0000 7ffb93400640 1 -- 172.21.15.146:0/554020099 shutdown_connections 2024-08-17T02:29:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.452+0000 7ffb93400640 1 -- 172.21.15.146:0/554020099 wait complete. 2024-08-17T02:29:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.453+0000 7ffb93400640 1 Processor -- start 2024-08-17T02:29:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.453+0000 7ffb93400640 1 -- start start 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb8c0b1440 0x7ffb8c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c1401b0 0x7ffb8c13e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c13ed30 con 0x7ffb8c140580 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c169e80 con 0x7ffb8c1401b0 2024-08-17T02:29:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb93400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c169cd0 con 0x7ffb8c0b1440 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb91400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb91400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51796/0 (socket says 172.21.15.146:51796) 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb91400640 1 -- 172.21.15.146:0/4190192245 learned_addr learned my addr 172.21.15.146:0/4190192245 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb83e00640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c1401b0 0x7ffb8c13e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.454+0000 7ffb90a00640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb8c0b1440 0x7ffb8c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 -- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb8c0b1440 msgr2=0x7ffb8c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb8c0b1440 0x7ffb8c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 -- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c1401b0 msgr2=0x7ffb8c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c1401b0 0x7ffb8c13e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 -- 172.21.15.146:0/4190192245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74009450 con 0x7ffb8c140580 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb91400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c8c0 tx=0x7ffb84002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400a7f0 con 0x7ffb8c140580 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8400a970 con 0x7ffb8c140580 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400ad30 con 0x7ffb8c140580 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c1690c0 con 0x7ffb8c140580 2024-08-17T02:29:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.455+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c169680 con 0x7ffb8c140580 2024-08-17T02:29:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.456+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c0c2370 con 0x7ffb8c140580 2024-08-17T02:29:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.457+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb84012630 con 0x7ffb8c140580 2024-08-17T02:29:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.458+0000 7ffb88c00640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 0x7ffb68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.458+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffb84082540 con 0x7ffb8c140580 2024-08-17T02:29:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.458+0000 7ffb90a00640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 0x7ffb68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.459+0000 7ffb90a00640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 0x7ffb68067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0011e0 tx=0x7ffb7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.462+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffb8c0c2370 con 0x7ffb8c140580 2024-08-17T02:29:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.635+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb8c0c2370 con 0x7ffb68065150 2024-08-17T02:29:29.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.636+0000 7ffb88c00640 1 -- 172.21.15.146:0/4190192245 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb8c0c2370 con 0x7ffb68065150 2024-08-17T02:29:29.636 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:29:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 msgr2=0x7ffb68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 0x7ffb68067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0011e0 tx=0x7ffb7c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 msgr2=0x7ffb8c13f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c8c0 tx=0x7ffb84002640 comp rx=0 tx=0).stop 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 shutdown_connections 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb68065150 0x7ffb68067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8c140580 0x7ffb8c13f000 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb8c1401b0 0x7ffb8c13e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 --2- 172.21.15.146:0/4190192245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb8c0b1440 0x7ffb8c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 >> 172.21.15.146:0/4190192245 conn(0x7ffb8c0cb9b0 msgr2=0x7ffb8c0ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 shutdown_connections 2024-08-17T02:29:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.638+0000 7ffb93400640 1 -- 172.21.15.146:0/4190192245 wait complete. 2024-08-17T02:29:29.653 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:29:29.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:29.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:29.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.807+0000 7ffb3ea00640 1 Processor -- start 2024-08-17T02:29:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.807+0000 7ffb3ea00640 1 -- start start 2024-08-17T02:29:29.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.808+0000 7ffb3ea00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffb38156890 0x7ffb3806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.808+0000 7ffb3ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb38156c60 0x7ffb3806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.808+0000 7ffb3ea00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb380ae9b0 con 0x7ffb380c8130 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.808+0000 7ffb3ea00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380aa730 con 0x7ffb38156c60 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.808+0000 7ffb3ea00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380aa9f0 con 0x7ffb38156890 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb38156c60 0x7ffb3806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb38156c60 0x7ffb3806e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51812/0 (socket says 172.21.15.146:51812) 2024-08-17T02:29:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 -- 172.21.15.146:0/4225809571 learned_addr learned my addr 172.21.15.146:0/4225809571 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37e00640 1 --2- 172.21.15.146:0/4225809571 >> v2:172.21.15.150:3300/0 conn(0x7ffb38156890 0x7ffb3806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 -- 172.21.15.146:0/4225809571 >> v2:172.21.15.150:3300/0 conn(0x7ffb38156890 msgr2=0x7ffb3806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:29.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 --2- 172.21.15.146:0/4225809571 >> v2:172.21.15.150:3300/0 conn(0x7ffb38156890 0x7ffb3806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 -- 172.21.15.146:0/4225809571 >> v1:172.21.15.150:6789/0 conn(0x7ffb380c8130 legacy=0x7ffb380c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.809+0000 7ffb37400640 1 -- 172.21.15.146:0/4225809571 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380ab320 con 0x7ffb38156c60 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.810+0000 7ffb37400640 1 --2- 172.21.15.146:0/4225809571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb38156c60 0x7ffb3806e420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806c5c0 tx=0x7ffb240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d97b1286db74a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.810+0000 7ffb36a00640 1 -- 172.21.15.146:0/4225809571 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2402add0 con 0x7ffb38156c60 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.810+0000 7ffb36a00640 1 -- 172.21.15.146:0/4225809571 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24032440 con 0x7ffb38156c60 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.810+0000 7ffb36a00640 1 -- 172.21.15.146:0/4225809571 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24032820 con 0x7ffb38156c60 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 -- 172.21.15.146:0/4225809571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb38156c60 msgr2=0x7ffb3806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/4225809571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb38156c60 0x7ffb3806e420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806c5c0 tx=0x7ffb240091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 -- 172.21.15.146:0/4225809571 shutdown_connections 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/4225809571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb38156c60 0x7ffb3806e420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/4225809571 >> v2:172.21.15.150:3300/0 conn(0x7ffb38156890 0x7ffb3806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 -- 172.21.15.146:0/4225809571 >> 172.21.15.146:0/4225809571 conn(0x7ffb38067750 msgr2=0x7ffb3806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 -- 172.21.15.146:0/4225809571 shutdown_connections 2024-08-17T02:29:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.811+0000 7ffb3ea00640 1 -- 172.21.15.146:0/4225809571 wait complete. 2024-08-17T02:29:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.812+0000 7ffb3ea00640 1 Processor -- start 2024-08-17T02:29:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.813+0000 7ffb3ea00640 1 -- start start 2024-08-17T02:29:29.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.813+0000 7ffb3ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 0x7ffb38145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.813+0000 7ffb3ea00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb38156890 0x7ffb38151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.813+0000 7ffb3ea00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb38156c60 0x7ffb380a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb3ea00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380a6a50 con 0x7ffb380c8130 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb3ea00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb381534b0 con 0x7ffb38156c60 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb3ea00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380a7e20 con 0x7ffb38156890 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 0x7ffb38145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 0x7ffb38145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51828/0 (socket says 172.21.15.146:51828) 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 -- 172.21.15.146:0/351101074 learned_addr learned my addr 172.21.15.146:0/351101074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb3ca00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb38156c60 0x7ffb380a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37400640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb38156890 0x7ffb38151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 -- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb38156890 msgr2=0x7ffb38151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb38156890 0x7ffb38151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 -- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb38156c60 msgr2=0x7ffb380a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb38156c60 0x7ffb380a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.814+0000 7ffb37e00640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009450 con 0x7ffb380c8130 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb37e00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 0x7ffb38145390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800ea20 tx=0x7ffb280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2800caa0 con 0x7ffb380c8130 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2800cc00 con 0x7ffb380c8130 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb380ac8b0 con 0x7ffb380c8130 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28013470 con 0x7ffb380c8130 2024-08-17T02:29:29.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.815+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb38152ef0 con 0x7ffb380c8130 2024-08-17T02:29:29.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.816+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb380710c0 con 0x7ffb380c8130 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.817+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffb28013820 con 0x7ffb380c8130 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.818+0000 7ffb2f400640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb18065150 0x7ffb18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.818+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffb28082850 con 0x7ffb380c8130 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.818+0000 7ffb37400640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb18065150 0x7ffb18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.818+0000 7ffb2f400640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7ffb1806b040 0x7ffb1806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.818+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb1806db00 con 0x7ffb1806b040 2024-08-17T02:29:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.819+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb28087240 con 0x7ffb380c8130 2024-08-17T02:29:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.819+0000 7ffb3ca00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7ffb1806b040 0x7ffb1806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.819+0000 7ffb37400640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb18065150 0x7ffb18067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffb24034000 tx=0x7ffb24032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.819+0000 7ffb3ca00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7ffb1806b040 0x7ffb1806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.820+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== osd.2 v2:172.21.15.146:6816/37117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ffb1806db00 con 0x7ffb1806b040 2024-08-17T02:29:29.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.833+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 --> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb38070740 con 0x7ffb1806b040 2024-08-17T02:29:29.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.833+0000 7ffb2f400640 1 -- 172.21.15.146:0/351101074 <== osd.2 v2:172.21.15.146:6816/37117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb38070740 con 0x7ffb1806b040 2024-08-17T02:29:29.834 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:29.834 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:29.834 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:29.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7ffb1806b040 msgr2=0x7ffb1806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6816/37117,v1:172.21.15.146:6817/37117] conn(0x7ffb1806b040 0x7ffb1806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb18065150 msgr2=0x7ffb18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7ffb18065150 0x7ffb18067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffb24034000 tx=0x7ffb24032000 comp rx=0 tx=0).stop 2024-08-17T02:29:29.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 msgr2=0x7ffb38145390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 --2- 172.21.15.146:0/351101074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb380c8130 0x7ffb38145390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800ea20 tx=0x7ffb280090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ca00640 1 -- 172.21.15.146:0/351101074 reap_dead start 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 shutdown_connections 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 >> 172.21.15.146:0/351101074 conn(0x7ffb38067750 msgr2=0x7ffb38153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 shutdown_connections 2024-08-17T02:29:29.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:29.834+0000 7ffb3ea00640 1 -- 172.21.15.146:0/351101074 wait complete. 2024-08-17T02:29:29.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:29:30.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.041+0000 7f47ed800640 1 Processor -- start 2024-08-17T02:29:30.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.041+0000 7f47ed800640 1 -- start start 2024-08-17T02:29:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.042+0000 7f47ed800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 0x7f47e806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.042+0000 7f47ed800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 0x7f47e80ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.042+0000 7f47ed800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80a9a10 con 0x7f47e80aa7d0 2024-08-17T02:29:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.042+0000 7f47ed800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80ac400 con 0x7f47e806da20 2024-08-17T02:29:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.042+0000 7f47ed800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80a9cf0 con 0x7f47e8158fa0 2024-08-17T02:29:30.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e7400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 0x7f47e80ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e6a00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 0x7f47e806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47de000640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f47e80aa7d0 0x7f47e8158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.146:38616/0 (socket says 172.21.15.146:38616) 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47de000640 1 -- 172.21.15.146:0/2045950404 learned_addr learned my addr 172.21.15.146:0/2045950404 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e7400640 1 -- 172.21.15.146:0/2045950404 >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 msgr2=0x7f47e806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e7400640 1 --2- 172.21.15.146:0/2045950404 >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 0x7f47e806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e7400640 1 -- 172.21.15.146:0/2045950404 >> v1:172.21.15.150:6789/0 conn(0x7f47e80aa7d0 legacy=0x7f47e8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e7400640 1 -- 172.21.15.146:0/2045950404 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80a9fd0 con 0x7f47e8158fa0 2024-08-17T02:29:30.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.043+0000 7f47e6a00640 1 --2- 172.21.15.146:0/2045950404 >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 0x7f47e806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.044+0000 7f47e7400640 1 --2- 172.21.15.146:0/2045950404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 0x7f47e80ab6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e60 tx=0x7f47e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50484c5433f76be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.044+0000 7f47e6000640 1 -- 172.21.15.146:0/2045950404 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007550 con 0x7f47e8158fa0 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47e6000640 1 -- 172.21.15.146:0/2045950404 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e002d050 con 0x7f47e8158fa0 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47e6000640 1 -- 172.21.15.146:0/2045950404 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0007920 con 0x7f47e8158fa0 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 -- 172.21.15.146:0/2045950404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 msgr2=0x7f47e80ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 --2- 172.21.15.146:0/2045950404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 0x7f47e80ab6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e60 tx=0x7f47e0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 -- 172.21.15.146:0/2045950404 shutdown_connections 2024-08-17T02:29:30.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 --2- 172.21.15.146:0/2045950404 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e8158fa0 0x7f47e80ab6d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 --2- 172.21.15.146:0/2045950404 >> v2:172.21.15.150:3300/0 conn(0x7f47e806da20 0x7f47e806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 -- 172.21.15.146:0/2045950404 >> 172.21.15.146:0/2045950404 conn(0x7f47e80cb9b0 msgr2=0x7f47e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 -- 172.21.15.146:0/2045950404 shutdown_connections 2024-08-17T02:29:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.045+0000 7f47ed800640 1 -- 172.21.15.146:0/2045950404 wait complete. 2024-08-17T02:29:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.047+0000 7f47ed800640 1 Processor -- start 2024-08-17T02:29:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.047+0000 7f47ed800640 1 -- start start 2024-08-17T02:29:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e806da20 0x7f47e80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 0x7f47e8156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8068c20 con 0x7f47e80aa7d0 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c9760 con 0x7f47e8158fa0 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47ed800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c9a40 con 0x7f47e806da20 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51836/0 (socket says 172.21.15.146:51836) 2024-08-17T02:29:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 -- 172.21.15.146:0/1914327511 learned_addr learned my addr 172.21.15.146:0/1914327511 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47e6a00640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e806da20 0x7f47e80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47e7400640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 0x7f47e8156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 -- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e806da20 msgr2=0x7f47e80c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e806da20 0x7f47e80c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 -- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 msgr2=0x7f47e8156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 0x7f47e8156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47de000640 1 -- 172.21.15.146:0/1914327511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009390 con 0x7f47e80aa7d0 2024-08-17T02:29:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.048+0000 7f47e7400640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 0x7f47e8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47de000640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c590 tx=0x7f47d0007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0005aa0 con 0x7f47e80aa7d0 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0005c20 con 0x7f47e80aa7d0 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00070f0 con 0x7f47e80aa7d0 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e0009a20 con 0x7f47e80aa7d0 2024-08-17T02:29:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.049+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81593a0 con 0x7f47e80aa7d0 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.050+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e80c9c60 con 0x7f47e80aa7d0 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.051+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47d0007540 con 0x7f47e80aa7d0 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.052+0000 7f47dea00640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 0x7f47c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.052+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f47d0081240 con 0x7f47e80aa7d0 2024-08-17T02:29:30.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.052+0000 7f47e6a00640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 0x7f47c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.052+0000 7f47e6a00640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 0x7f47c4067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009eb0 tx=0x7f47d80090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.056+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47d004f630 con 0x7f47e80aa7d0 2024-08-17T02:29:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.227+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f47e8064db0 con 0x7f47c4065150 2024-08-17T02:29:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.227+0000 7f47dea00640 1 -- 172.21.15.146:0/1914327511 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47e8064db0 con 0x7f47c4065150 2024-08-17T02:29:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 msgr2=0x7f47c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 0x7f47c4067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009eb0 tx=0x7f47d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 msgr2=0x7f47e8156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c590 tx=0x7f47d0007ee0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 shutdown_connections 2024-08-17T02:29:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f47c4065150 0x7f47c4067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47e80aa7d0 0x7f47e8156a60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47e8158fa0 0x7f47e8156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 --2- 172.21.15.146:0/1914327511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f47e806da20 0x7f47e80c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 >> 172.21.15.146:0/1914327511 conn(0x7f47e80cb9b0 msgr2=0x7f47e806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 shutdown_connections 2024-08-17T02:29:30.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.229+0000 7f47ed800640 1 -- 172.21.15.146:0/1914327511 wait complete. 2024-08-17T02:29:30.245 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:29:30.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.402+0000 7f0bfa800640 1 Processor -- start 2024-08-17T02:29:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.402+0000 7f0bfa800640 1 -- start start 2024-08-17T02:29:30.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bfa800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0bf40b5740 0x7f0bf415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bfa800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bf415c2e0 0x7f0bf40aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bfa800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40d0a80 con 0x7f0bf40b2bb0 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bfa800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf40b2130 con 0x7f0bf415c2e0 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bfa800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf40b23f0 con 0x7f0bf40b5740 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.403+0000 7f0bf9e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bf415c2e0 0x7f0bf40aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bf415c2e0 0x7f0bf40aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51850/0 (socket says 172.21.15.146:51850) 2024-08-17T02:29:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3596307113 learned_addr learned my addr 172.21.15.146:0/3596307113 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9400640 1 --1- 172.21.15.146:0/3596307113 >> v1:172.21.15.146:6789/0 conn(0x7f0bf40b2bb0 0x7f0bf40b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42456/0 (socket says 172.21.15.146:42456) 2024-08-17T02:29:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf8a00640 1 --2- 172.21.15.146:0/3596307113 >> v2:172.21.15.150:3300/0 conn(0x7f0bf40b5740 0x7f0bf415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3596307113 >> v2:172.21.15.150:3300/0 conn(0x7f0bf40b5740 msgr2=0x7f0bf415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 --2- 172.21.15.146:0/3596307113 >> v2:172.21.15.150:3300/0 conn(0x7f0bf40b5740 0x7f0bf415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3596307113 >> v1:172.21.15.146:6789/0 conn(0x7f0bf40b2bb0 legacy=0x7f0bf40b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.404+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3596307113 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40b37a0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.405+0000 7f0bf9e00640 1 --2- 172.21.15.146:0/3596307113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf40aac20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f20 tx=0x7f0bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2034b6da48f99f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.405+0000 7f0bf3e00640 1 -- 172.21.15.146:0/3596307113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec032470 con 0x7f0bf415c2e0 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.405+0000 7f0bf3e00640 1 -- 172.21.15.146:0/3596307113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec0325d0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.405+0000 7f0bf3e00640 1 -- 172.21.15.146:0/3596307113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec0329b0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 -- 172.21.15.146:0/3596307113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 msgr2=0x7f0bf40aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3596307113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf40aac20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f20 tx=0x7f0bec009840 comp rx=0 tx=0).stop 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 -- 172.21.15.146:0/3596307113 shutdown_connections 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3596307113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf40aac20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3596307113 >> v2:172.21.15.150:3300/0 conn(0x7f0bf40b5740 0x7f0bf415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 -- 172.21.15.146:0/3596307113 >> 172.21.15.146:0/3596307113 conn(0x7f0bf40cfbc0 msgr2=0x7f0bf40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 -- 172.21.15.146:0/3596307113 shutdown_connections 2024-08-17T02:29:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.406+0000 7f0bfa800640 1 -- 172.21.15.146:0/3596307113 wait complete. 2024-08-17T02:29:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.407+0000 7f0bfa800640 1 Processor -- start 2024-08-17T02:29:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 -- start start 2024-08-17T02:29:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf40b2bb0 0x7f0bf4168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf40b5740 0x7f0bf416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415e370 con 0x7f0bf415c2e0 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415e650 con 0x7f0bf40b2bb0 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.408+0000 7f0bfa800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4157ef0 con 0x7f0bf40b5740 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf41542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51866/0 (socket says 172.21.15.146:51866) 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3883151843 learned_addr learned my addr 172.21.15.146:0/3883151843 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9400640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf40b2bb0 0x7f0bf4168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf8a00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf40b5740 0x7f0bf416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf40b5740 msgr2=0x7f0bf416cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0bf40b5740 0x7f0bf416cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf40b2bb0 msgr2=0x7f0bf4168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bf40b2bb0 0x7f0bf4168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.409+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec009ae0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bf9e00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf41542c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f80 tx=0x7f0bec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec032470 con 0x7f0bf415c2e0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec007170 con 0x7f0bf415c2e0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec03c660 con 0x7f0bf415c2e0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf4155f10 con 0x7f0bf415c2e0 2024-08-17T02:29:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.410+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf41564d0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.411+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bf41566f0 con 0x7f0bf415c2e0 2024-08-17T02:29:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.412+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0bec003020 con 0x7f0bf415c2e0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf0c00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0bd4065180 0x7f0bd4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0bec0a2f80 con 0x7f0bf415c2e0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf0c00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f0bd406afa0 0x7f0bd406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bd406da60 con 0x7f0bd406afa0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bec0a5560 con 0x7f0bf415c2e0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf9400640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0bd4065180 0x7f0bd4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.413+0000 7f0bf8a00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f0bd406afa0 0x7f0bd406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.414+0000 7f0bf9400640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0bd4065180 0x7f0bd4067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0be8007800 tx=0x7f0be8007e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.414+0000 7f0bf8a00640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f0bd406afa0 0x7f0bd406d3b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.414+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== osd.3 v2:172.21.15.146:6824/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0bd406da60 con 0x7f0bd406afa0 2024-08-17T02:29:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.427+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 --> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0bf4071050 con 0x7f0bd406afa0 2024-08-17T02:29:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.427+0000 7f0bf0c00640 1 -- 172.21.15.146:0/3883151843 <== osd.3 v2:172.21.15.146:6824/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0bf4071050 con 0x7f0bd406afa0 2024-08-17T02:29:30.428 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:30.428 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:30.428 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:30.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f0bd406afa0 msgr2=0x7f0bd406d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6824/37127,v1:172.21.15.146:6825/37127] conn(0x7f0bd406afa0 0x7f0bd406d3b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0bd4065180 msgr2=0x7f0bd4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f0bd4065180 0x7f0bd4067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0be8007800 tx=0x7f0be8007e20 comp rx=0 tx=0).stop 2024-08-17T02:29:30.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 msgr2=0x7f0bf41542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 --2- 172.21.15.146:0/3883151843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bf415c2e0 0x7f0bf41542c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009f80 tx=0x7f0bec037000 comp rx=0 tx=0).stop 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bf9e00640 1 -- 172.21.15.146:0/3883151843 reap_dead start 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 shutdown_connections 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 >> 172.21.15.146:0/3883151843 conn(0x7f0bf40cfbc0 msgr2=0x7f0bf40b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 shutdown_connections 2024-08-17T02:29:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.428+0000 7f0bfa800640 1 -- 172.21.15.146:0/3883151843 wait complete. 2024-08-17T02:29:30.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:29:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.594+0000 7f653e600640 1 Processor -- start 2024-08-17T02:29:30.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.595+0000 7f653e600640 1 -- start start 2024-08-17T02:29:30.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f65380af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65380aa910 0x7f65380ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 0x7f65380acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380abc80 con 0x7f65380aa910 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65380ab070 con 0x7f65380ac650 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f653e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380ab350 con 0x7f6538158cb0 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65380aa910 0x7f65380ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65380aa910 0x7f65380ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51876/0 (socket says 172.21.15.146:51876) 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 -- 172.21.15.146:0/578152382 learned_addr learned my addr 172.21.15.146:0/578152382 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f6537e00640 1 --2- 172.21.15.146:0/578152382 >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 0x7f65380acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f6537400640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f65380af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 -- 172.21.15.146:0/578152382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 msgr2=0x7f65380af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f65380af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 -- 172.21.15.146:0/578152382 >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 msgr2=0x7f65380acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 --2- 172.21.15.146:0/578152382 >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 0x7f65380acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.596+0000 7f652fe00640 1 -- 172.21.15.146:0/578152382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380ab630 con 0x7f65380aa910 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.597+0000 7f6537400640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f65380af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.597+0000 7f6537e00640 1 --2- 172.21.15.146:0/578152382 >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 0x7f65380acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.598+0000 7f652fe00640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380aa910 0x7f65380ac110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f65380ad4b0 tx=0x7f65200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1a2630551a9e85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.598+0000 7f6536a00640 1 -- 172.21.15.146:0/578152382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652002add0 con 0x7f65380aa910 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.598+0000 7f6536a00640 1 -- 172.21.15.146:0/578152382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6520032440 con 0x7f65380aa910 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.598+0000 7f6536a00640 1 -- 172.21.15.146:0/578152382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520032820 con 0x7f65380aa910 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 -- 172.21.15.146:0/578152382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380aa910 msgr2=0x7f65380ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380aa910 0x7f65380ac110 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f65380ad4b0 tx=0x7f65200091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 -- 172.21.15.146:0/578152382 shutdown_connections 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 --2- 172.21.15.146:0/578152382 >> v2:172.21.15.150:3300/0 conn(0x7f65380ac650 0x7f65380acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380aa910 0x7f65380ac110 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 --2- 172.21.15.146:0/578152382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f65380af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 -- 172.21.15.146:0/578152382 >> 172.21.15.146:0/578152382 conn(0x7f6538096a70 msgr2=0x7f6538096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 -- 172.21.15.146:0/578152382 shutdown_connections 2024-08-17T02:29:30.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.599+0000 7f653e600640 1 -- 172.21.15.146:0/578152382 wait complete. 2024-08-17T02:29:30.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.600+0000 7f653e600640 1 Processor -- start 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 -- start start 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 0x7f65380c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f653809b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653809ac80 con 0x7f65380ac650 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c7780 con 0x7f65380aa910 2024-08-17T02:29:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.601+0000 7f653e600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380c7a60 con 0x7f6538158cb0 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51890/0 (socket says 172.21.15.146:51890) 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 -- 172.21.15.146:0/216701123 learned_addr learned my addr 172.21.15.146:0/216701123 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f6537400640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 0x7f65380c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f6537e00640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f653809b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 -- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 msgr2=0x7f653809b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f653809b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 -- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 msgr2=0x7f65380c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 0x7f65380c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f652fe00640 1 -- 172.21.15.146:0/216701123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6520009450 con 0x7f65380ac650 2024-08-17T02:29:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.602+0000 7f6537400640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 0x7f65380c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f652fe00640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6520009210 tx=0x7f6520032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520006b30 con 0x7f65380ac650 2024-08-17T02:29:30.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6520031a40 con 0x7f65380ac650 2024-08-17T02:29:30.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520031e00 con 0x7f65380ac650 2024-08-17T02:29:30.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65380c7d40 con 0x7f65380ac650 2024-08-17T02:29:30.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.603+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6538099b60 con 0x7f65380ac650 2024-08-17T02:29:30.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.604+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6538064db0 con 0x7f65380ac650 2024-08-17T02:29:30.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.605+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6520039040 con 0x7f65380ac650 2024-08-17T02:29:30.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.606+0000 7f652ea00640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 0x7f6514067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.606+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f65200a1db0 con 0x7f65380ac650 2024-08-17T02:29:30.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.606+0000 7f6537400640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 0x7f6514067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.607+0000 7f6537400640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 0x7f6514067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65380af3d0 tx=0x7f6528008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.613+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6520070120 con 0x7f65380ac650 2024-08-17T02:29:30.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.793+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f65380acf90 con 0x7f6514065180 2024-08-17T02:29:30.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.793+0000 7f652ea00640 1 -- 172.21.15.146:0/216701123 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f65380acf90 con 0x7f6514065180 2024-08-17T02:29:30.793 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:29:30.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 msgr2=0x7f6514067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 0x7f6514067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65380af3d0 tx=0x7f6528008040 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 msgr2=0x7f6538099620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6520009210 tx=0x7f6520032000 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 shutdown_connections 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f6514065180 0x7f6514067630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65380ac650 0x7f6538099620 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6538158cb0 0x7f653809b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 --2- 172.21.15.146:0/216701123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65380aa910 0x7f65380c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.795+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 >> 172.21.15.146:0/216701123 conn(0x7f6538096a70 msgr2=0x7f65380ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.796+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 shutdown_connections 2024-08-17T02:29:30.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.796+0000 7f653e600640 1 -- 172.21.15.146:0/216701123 wait complete. 2024-08-17T02:29:30.811 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:29:30.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.970+0000 7f1810000640 1 Processor -- start 2024-08-17T02:29:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.970+0000 7f1810000640 1 -- start start 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.971+0000 7f1810000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808150130 0x7f18080aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.971+0000 7f1810000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1808156d40 0x7f180806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f1810000640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18081568b0 con 0x7f180806e420 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f1810000640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180806e8a0 con 0x7f1808156d40 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f1810000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1808150500 con 0x7f1808150130 2024-08-17T02:29:30.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f180cc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1808156d40 0x7f180806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f180e000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f180806e420 0x7f18080afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42466/0 (socket says 172.21.15.146:42466) 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f180e000640 1 -- 172.21.15.146:0/871090789 learned_addr learned my addr 172.21.15.146:0/871090789 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.972+0000 7f180d600640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808150130 0x7f18080aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.973+0000 7f180cc00640 1 -- 172.21.15.146:0/871090789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808150130 msgr2=0x7f18080aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.973+0000 7f180cc00640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808150130 0x7f18080aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.973+0000 7f180cc00640 1 -- 172.21.15.146:0/871090789 >> v1:172.21.15.146:6789/0 conn(0x7f180806e420 legacy=0x7f18080afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.973+0000 7f180cc00640 1 -- 172.21.15.146:0/871090789 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808155fc0 con 0x7f1808156d40 2024-08-17T02:29:30.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.973+0000 7f1807e00640 1 -- 172.21.15.146:0/871090789 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539408282 0 0) 0x7f18081568b0 con 0x7f180806e420 2024-08-17T02:29:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.974+0000 7f180cc00640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808156d40 0x7f180806dee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009850 tx=0x7f17f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4b638b8dbe88d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1807e00640 1 -- 172.21.15.146:0/871090789 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f402ad00 con 0x7f1808156d40 2024-08-17T02:29:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1807e00640 1 -- 172.21.15.146:0/871090789 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f402ae60 con 0x7f1808156d40 2024-08-17T02:29:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1807e00640 1 -- 172.21.15.146:0/871090789 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4032670 con 0x7f1808156d40 2024-08-17T02:29:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 -- 172.21.15.146:0/871090789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808156d40 msgr2=0x7f180806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808156d40 0x7f180806dee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009850 tx=0x7f17f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 -- 172.21.15.146:0/871090789 shutdown_connections 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808156d40 0x7f180806dee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 --2- 172.21.15.146:0/871090789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808150130 0x7f18080aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 -- 172.21.15.146:0/871090789 >> 172.21.15.146:0/871090789 conn(0x7f1808067750 msgr2=0x7f180806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 -- 172.21.15.146:0/871090789 shutdown_connections 2024-08-17T02:29:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.975+0000 7f1810000640 1 -- 172.21.15.146:0/871090789 wait complete. 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.977+0000 7f1810000640 1 Processor -- start 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.977+0000 7f1810000640 1 -- start start 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f180806e420 0x7f180814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 0x7f18080acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808156d40 0x7f18080ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1808166930 con 0x7f1808150130 2024-08-17T02:29:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1808167900 con 0x7f180806e420 2024-08-17T02:29:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f1810000640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18081530c0 con 0x7f1808156d40 2024-08-17T02:29:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f180cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 0x7f18080acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f180cc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 0x7f18080acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51908/0 (socket says 172.21.15.146:51908) 2024-08-17T02:29:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.978+0000 7f180cc00640 1 -- 172.21.15.146:0/3136617885 learned_addr learned my addr 172.21.15.146:0/3136617885 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180e000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808156d40 0x7f18080ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180d600640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f180806e420 0x7f180814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 -- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808156d40 msgr2=0x7f18080ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808156d40 0x7f18080ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 -- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f180806e420 msgr2=0x7f180814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f180806e420 0x7f180814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009390 con 0x7f1808150130 2024-08-17T02:29:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180e000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1808156d40 0x7f18080ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180d600640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f180806e420 0x7f180814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f180cc00640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 0x7f18080acf30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009360 tx=0x7f17f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.979+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f403b6e0 con 0x7f1808150130 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.980+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f403b840 con 0x7f1808150130 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.980+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f403bbe0 con 0x7f1808150130 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.980+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1808167470 con 0x7f1808150130 2024-08-17T02:29:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.980+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1808166e20 con 0x7f1808150130 2024-08-17T02:29:30.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.981+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18080710c0 con 0x7f1808150130 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.982+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f17f4043030 con 0x7f1808150130 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.982+0000 7f1804c00640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f17e8065150 0x7f17e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f17f4041070 con 0x7f1808150130 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f1804c00640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f17e806b040 0x7f17e806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17e806db00 con 0x7f17e806b040 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f40a4db0 con 0x7f1808150130 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f180d600640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f17e8065150 0x7f17e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.983+0000 7f180e000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f17e806b040 0x7f17e806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.984+0000 7f180d600640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f17e8065150 0x7f17e8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006e70 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.984+0000 7f180e000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f17e806b040 0x7f17e806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.985+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== osd.4 v2:172.21.15.150:6808/37541 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f17e806db00 con 0x7f17e806b040 2024-08-17T02:29:30.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.998+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 --> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f180814e430 con 0x7f17e806b040 2024-08-17T02:29:30.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.998+0000 7f1804c00640 1 -- 172.21.15.146:0/3136617885 <== osd.4 v2:172.21.15.150:6808/37541 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f180814e430 con 0x7f17e806b040 2024-08-17T02:29:30.999 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:30.999 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:30.999 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f17e806b040 msgr2=0x7f17e806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.150:6808/37541,v1:172.21.15.150:6809/37541] conn(0x7f17e806b040 0x7f17e806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f17e8065150 msgr2=0x7f17e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f17e8065150 0x7f17e8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17fc006e70 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:31.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 msgr2=0x7f18080acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 --2- 172.21.15.146:0/3136617885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1808150130 0x7f18080acf30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009360 tx=0x7f17f4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f180e000640 1 -- 172.21.15.146:0/3136617885 reap_dead start 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 shutdown_connections 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 >> 172.21.15.146:0/3136617885 conn(0x7f1808067750 msgr2=0x7f1808155840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 shutdown_connections 2024-08-17T02:29:31.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:30.999+0000 7f1810000640 1 -- 172.21.15.146:0/3136617885 wait complete. 2024-08-17T02:29:31.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:29:31.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.166+0000 7fa63fe00640 1 Processor -- start 2024-08-17T02:29:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.166+0000 7fa63fe00640 1 -- start start 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.167+0000 7fa63fe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa640159ca0 0x7fa6400ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.167+0000 7fa63fe00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6400ca8a0 0x7fa6400cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.167+0000 7fa63fe00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6400ccf30 con 0x7fa6400ccad0 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.167+0000 7fa63fe00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400cd6e0 con 0x7fa640159ca0 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.167+0000 7fa63fe00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400cadc0 con 0x7fa6400ca8a0 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa640159ca0 0x7fa6400ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa640159ca0 0x7fa6400ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51924/0 (socket says 172.21.15.146:51924) 2024-08-17T02:29:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 -- 172.21.15.146:0/899101566 learned_addr learned my addr 172.21.15.146:0/899101566 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 -- 172.21.15.146:0/899101566 >> v2:172.21.15.150:3300/0 conn(0x7fa6400ca8a0 msgr2=0x7fa6400cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 --2- 172.21.15.146:0/899101566 >> v2:172.21.15.150:3300/0 conn(0x7fa6400ca8a0 0x7fa6400cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 -- 172.21.15.146:0/899101566 >> v1:172.21.15.150:6789/0 conn(0x7fa6400ccad0 legacy=0x7fa6400cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.168+0000 7fa63ea00640 1 -- 172.21.15.146:0/899101566 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400cb060 con 0x7fa640159ca0 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.169+0000 7fa63ea00640 1 --2- 172.21.15.146:0/899101566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa640159ca0 0x7fa6400ca360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa64008a320 tx=0x7fa6300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eea5dae1db12a5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.169+0000 7fa63d600640 1 -- 172.21.15.146:0/899101566 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63002add0 con 0x7fa640159ca0 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.169+0000 7fa63d600640 1 -- 172.21.15.146:0/899101566 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630032440 con 0x7fa640159ca0 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.169+0000 7fa63d600640 1 -- 172.21.15.146:0/899101566 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630032820 con 0x7fa640159ca0 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 -- 172.21.15.146:0/899101566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa640159ca0 msgr2=0x7fa6400ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 --2- 172.21.15.146:0/899101566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa640159ca0 0x7fa6400ca360 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa64008a320 tx=0x7fa6300091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 -- 172.21.15.146:0/899101566 shutdown_connections 2024-08-17T02:29:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 --2- 172.21.15.146:0/899101566 >> v2:172.21.15.150:3300/0 conn(0x7fa6400ca8a0 0x7fa6400cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 --2- 172.21.15.146:0/899101566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa640159ca0 0x7fa6400ca360 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 -- 172.21.15.146:0/899101566 >> 172.21.15.146:0/899101566 conn(0x7fa640098e00 msgr2=0x7fa64006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 -- 172.21.15.146:0/899101566 shutdown_connections 2024-08-17T02:29:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.170+0000 7fa63fe00640 1 -- 172.21.15.146:0/899101566 wait complete. 2024-08-17T02:29:31.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.171+0000 7fa63fe00640 1 Processor -- start 2024-08-17T02:29:31.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 -- start start 2024-08-17T02:29:31.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 0x7fa6400c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 0x7fa6400c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640154f30 con 0x7fa6400ca8a0 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401691f0 con 0x7fa640159ca0 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.172+0000 7fa63fe00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401694d0 con 0x7fa6400ccad0 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51926/0 (socket says 172.21.15.146:51926) 2024-08-17T02:29:31.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 -- 172.21.15.146:0/2521686276 learned_addr learned my addr 172.21.15.146:0/2521686276 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63e000640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 0x7fa6400c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63f400640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 0x7fa6400c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 -- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 msgr2=0x7fa6400c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 0x7fa6400c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 -- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 msgr2=0x7fa6400c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 0x7fa6400c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 -- 172.21.15.146:0/2521686276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630009450 con 0x7fa6400ca8a0 2024-08-17T02:29:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63e000640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 0x7fa6400c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63f400640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 0x7fa6400c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.173+0000 7fa63ea00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa630009910 tx=0x7fa630032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.174+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630006ea0 con 0x7fa6400ca8a0 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.174+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630031b30 con 0x7fa6400ca8a0 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.174+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63003e450 con 0x7fa6400ca8a0 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.174+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6401697b0 con 0x7fa6400ca8a0 2024-08-17T02:29:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.174+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6400c7100 con 0x7fa6400ca8a0 2024-08-17T02:29:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.175+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa640071050 con 0x7fa6400ca8a0 2024-08-17T02:29:31.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.176+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa63003c400 con 0x7fa6400ca8a0 2024-08-17T02:29:31.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.177+0000 7fa636000640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 0x7fa620067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.177+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa6300a2340 con 0x7fa6400ca8a0 2024-08-17T02:29:31.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.177+0000 7fa63e000640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 0x7fa620067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.178+0000 7fa63e000640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 0x7fa620067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006fd0 tx=0x7fa62c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.181+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa6300706a0 con 0x7fa6400ca8a0 2024-08-17T02:29:31.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.358+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa64016c360 con 0x7fa620065150 2024-08-17T02:29:31.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.358+0000 7fa636000640 1 -- 172.21.15.146:0/2521686276 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa64016c360 con 0x7fa620065150 2024-08-17T02:29:31.359 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:29:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.360+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 msgr2=0x7fa620067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.360+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 0x7fa620067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006fd0 tx=0x7fa62c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.360+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 msgr2=0x7fa6401549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.360+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa630009910 tx=0x7fa630032000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 shutdown_connections 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fa620065150 0x7fa620067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa640159ca0 0x7fa6400c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa6400ccad0 0x7fa6400c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 --2- 172.21.15.146:0/2521686276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400ca8a0 0x7fa6401549f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 >> 172.21.15.146:0/2521686276 conn(0x7fa640098e00 msgr2=0x7fa640159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 shutdown_connections 2024-08-17T02:29:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.361+0000 7fa63fe00640 1 -- 172.21.15.146:0/2521686276 wait complete. 2024-08-17T02:29:31.375 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:29:31.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.531+0000 7f11e1e00640 1 Processor -- start 2024-08-17T02:29:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.531+0000 7f11e1e00640 1 -- start start 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156890 0x7f11dc06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11dc156c60 0x7f11dc06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f11dc0c8130 0x7f11dc0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc0ae9b0 con 0x7f11dc156c60 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc0ab320 con 0x7f11dc0c8130 2024-08-17T02:29:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11e1e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0aa730 con 0x7f11dc156890 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11da000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11dc156c60 0x7f11dc06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11da000640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11dc156c60 0x7f11dc06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51934/0 (socket says 172.21.15.146:51934) 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11da000640 1 -- 172.21.15.146:0/240627389 learned_addr learned my addr 172.21.15.146:0/240627389 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11daa00640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156890 0x7f11dc06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.532+0000 7f11db400640 1 --2- 172.21.15.146:0/240627389 >> v2:172.21.15.150:3300/0 conn(0x7f11dc0c8130 0x7f11dc0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.533+0000 7f11da000640 1 -- 172.21.15.146:0/240627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156890 msgr2=0x7f11dc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.533+0000 7f11da000640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156890 0x7f11dc06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.533+0000 7f11da000640 1 -- 172.21.15.146:0/240627389 >> v2:172.21.15.150:3300/0 conn(0x7f11dc0c8130 msgr2=0x7f11dc0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.533+0000 7f11da000640 1 --2- 172.21.15.146:0/240627389 >> v2:172.21.15.150:3300/0 conn(0x7f11dc0c8130 0x7f11dc0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.533+0000 7f11da000640 1 -- 172.21.15.146:0/240627389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0aa9f0 con 0x7f11dc156c60 2024-08-17T02:29:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.534+0000 7f11da000640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156c60 0x7f11dc06e420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0ab290 tx=0x7f11c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad75877f4865e77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11d9600640 1 -- 172.21.15.146:0/240627389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c802add0 con 0x7f11dc156c60 2024-08-17T02:29:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11d9600640 1 -- 172.21.15.146:0/240627389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8032440 con 0x7f11dc156c60 2024-08-17T02:29:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11d9600640 1 -- 172.21.15.146:0/240627389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8032820 con 0x7f11dc156c60 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 -- 172.21.15.146:0/240627389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156c60 msgr2=0x7f11dc06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156c60 0x7f11dc06e420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0ab290 tx=0x7f11c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 -- 172.21.15.146:0/240627389 shutdown_connections 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 --2- 172.21.15.146:0/240627389 >> v2:172.21.15.150:3300/0 conn(0x7f11dc0c8130 0x7f11dc0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156c60 0x7f11dc06e420 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 --2- 172.21.15.146:0/240627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156890 0x7f11dc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.535+0000 7f11e1e00640 1 -- 172.21.15.146:0/240627389 >> 172.21.15.146:0/240627389 conn(0x7f11dc067750 msgr2=0x7f11dc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.536+0000 7f11e1e00640 1 -- 172.21.15.146:0/240627389 shutdown_connections 2024-08-17T02:29:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.536+0000 7f11e1e00640 1 -- 172.21.15.146:0/240627389 wait complete. 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.537+0000 7f11e1e00640 1 Processor -- start 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.537+0000 7f11e1e00640 1 -- start start 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11dc0c8130 0x7f11dc15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 0x7f11dc166930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156c60 0x7f11dc15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc158410 con 0x7f11dc156890 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc158cb0 con 0x7f11dc0c8130 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11e1e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc158080 con 0x7f11dc156c60 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11da000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 0x7f11dc166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11da000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 0x7f11dc166930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51944/0 (socket says 172.21.15.146:51944) 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11da000640 1 -- 172.21.15.146:0/2086120187 learned_addr learned my addr 172.21.15.146:0/2086120187 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11db400640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156c60 0x7f11dc15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.538+0000 7f11daa00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11dc0c8130 0x7f11dc15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 -- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156c60 msgr2=0x7f11dc15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f11dc156c60 0x7f11dc15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 -- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11dc0c8130 msgr2=0x7f11dc15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f11dc0c8130 0x7f11dc15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009450 con 0x7f11dc156890 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11da000640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 0x7f11dc166930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009210 tx=0x7f11c8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8031bb0 con 0x7f11dc156890 2024-08-17T02:29:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8031d30 con 0x7f11dc156890 2024-08-17T02:29:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc158660 con 0x7f11dc156890 2024-08-17T02:29:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.539+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8031ea0 con 0x7f11dc156890 2024-08-17T02:29:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.540+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc15b520 con 0x7f11dc156890 2024-08-17T02:29:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.540+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11dc0710c0 con 0x7f11dc156890 2024-08-17T02:29:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.541+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f11c8039040 con 0x7f11dc156890 2024-08-17T02:29:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.542+0000 7f11d2000640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11bc065150 0x7f11bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.542+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f11c80a1fe0 con 0x7f11dc156890 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.542+0000 7f11daa00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11bc065150 0x7f11bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.543+0000 7f11d2000640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f11bc06b040 0x7f11bc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.543+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11bc06db00 con 0x7f11bc06b040 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.543+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11c80a4560 con 0x7f11dc156890 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.543+0000 7f11db400640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f11bc06b040 0x7f11bc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.543+0000 7f11daa00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11bc065150 0x7f11bc067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009d20 tx=0x7f11cc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.544+0000 7f11db400640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f11bc06b040 0x7f11bc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.545+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== osd.5 v2:172.21.15.150:6824/37542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f11bc06db00 con 0x7f11bc06b040 2024-08-17T02:29:31.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.557+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 --> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11dc166e70 con 0x7f11bc06b040 2024-08-17T02:29:31.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11d2000640 1 -- 172.21.15.146:0/2086120187 <== osd.5 v2:172.21.15.150:6824/37542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f11dc166e70 con 0x7f11bc06b040 2024-08-17T02:29:31.558 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:31.558 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:31.558 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f11bc06b040 msgr2=0x7f11bc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.150:6824/37542,v1:172.21.15.150:6825/37542] conn(0x7f11bc06b040 0x7f11bc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11bc065150 msgr2=0x7f11bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f11bc065150 0x7f11bc067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009d20 tx=0x7f11cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 msgr2=0x7f11dc166930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 --2- 172.21.15.146:0/2086120187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11dc156890 0x7f11dc166930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009210 tx=0x7f11c8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11db400640 1 -- 172.21.15.146:0/2086120187 reap_dead start 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 shutdown_connections 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 >> 172.21.15.146:0/2086120187 conn(0x7f11dc067750 msgr2=0x7f11dc0aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.558+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 shutdown_connections 2024-08-17T02:29:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.559+0000 7f11e1e00640 1 -- 172.21.15.146:0/2086120187 wait complete. 2024-08-17T02:29:31.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:29:31.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.727+0000 7fc3f3e00640 1 Processor -- start 2024-08-17T02:29:31.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.727+0000 7fc3f3e00640 1 -- start start 2024-08-17T02:29:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3e00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc3f40ceb40 0x7fc3f40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40ccf30 con 0x7fc3f40ccad0 2024-08-17T02:29:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40cadc0 con 0x7fc3f4159ca0 2024-08-17T02:29:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3e00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40cd6e0 con 0x7fc3f40ceb40 2024-08-17T02:29:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3f40ccad0 0x7fc3f4162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42478/0 (socket says 172.21.15.146:42478) 2024-08-17T02:29:31.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f3400640 1 -- 172.21.15.146:0/180250955 learned_addr learned my addr 172.21.15.146:0/180250955 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f2000640 1 --2- 172.21.15.146:0/180250955 >> v2:172.21.15.150:3300/0 conn(0x7fc3f40ceb40 0x7fc3f40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.728+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789250620 0 0) 0x7fc3f40ccf30 con 0x7fc3f40ccad0 2024-08-17T02:29:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3d80034e0 con 0x7fc3f40ccad0 2024-08-17T02:29:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054433375 0 0) 0x7fc3f40cadc0 con 0x7fc3f4159ca0 2024-08-17T02:29:31.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f40ccf30 con 0x7fc3f4159ca0 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1632956254 0 0) 0x7fc3d80034e0 con 0x7fc3f40ccad0 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 >> v2:172.21.15.150:3300/0 conn(0x7fc3f40ceb40 msgr2=0x7fc3f40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 --2- 172.21.15.146:0/180250955 >> v2:172.21.15.150:3300/0 conn(0x7fc3f40ceb40 0x7fc3f40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 >> v1:172.21.15.150:6789/0 conn(0x7fc3f4159ca0 legacy=0x7fc3f40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40cb060 con 0x7fc3f40ccad0 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7fc3ec001810 con 0x7fc3f40ccad0 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 >> v1:172.21.15.146:6789/0 conn(0x7fc3f40ccad0 legacy=0x7fc3f4162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d8003b60 0x7fc3d8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d8004780 0x7fc3d8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cd6e0 con 0x7fc3d8005130 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d800c020 con 0x7fc3d8004780 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d800c1e0 con 0x7fc3d8003b60 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f3400640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f2000640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d8004780 0x7fc3d8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.729+0000 7fc3f2a00640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d8003b60 0x7fc3d8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f3400640 1 -- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d8003b60 msgr2=0x7fc3d8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f3400640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3d8003b60 0x7fc3d8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f3400640 1 -- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d8004780 msgr2=0x7fc3d8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f3400640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d8004780 0x7fc3d8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f3400640 1 -- 172.21.15.146:0/180250955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80034e0 con 0x7fc3d8005130 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.730+0000 7fc3f2000640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3d8004780 0x7fc3d8004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.731+0000 7fc3f3400640 1 -- 172.21.15.146:0/180250955 reap_dead start 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.731+0000 7fc3f3400640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3d800b9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00a920 tx=0x7fc3f40cb860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad642ad460f205e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.731+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec02b520 con 0x7fc3d8005130 2024-08-17T02:29:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.731+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec02b6a0 con 0x7fc3d8005130 2024-08-17T02:29:31.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.731+0000 7fc3f1600640 1 -- 172.21.15.146:0/180250955 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec02ba60 con 0x7fc3d8005130 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 -- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 msgr2=0x7fc3d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3d800b9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00a920 tx=0x7fc3f40cb860 comp rx=0 tx=0).stop 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 -- 172.21.15.146:0/180250955 shutdown_connections 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/180250955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3d800b9d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 -- 172.21.15.146:0/180250955 >> 172.21.15.146:0/180250955 conn(0x7fc3f4098e00 msgr2=0x7fc3f406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 -- 172.21.15.146:0/180250955 shutdown_connections 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.732+0000 7fc3f3e00640 1 -- 172.21.15.146:0/180250955 wait complete. 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.733+0000 7fc3f3e00640 1 Processor -- start 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.733+0000 7fc3f3e00640 1 -- start start 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3f409cd20 0x7fc3f40c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3f40c4b00 0x7fc3f409c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c5010 con 0x7fc3d8005130 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c52f0 con 0x7fc3f409cd20 2024-08-17T02:29:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.734+0000 7fc3f3e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c55d0 con 0x7fc3f40c4b00 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51964/0 (socket says 172.21.15.146:51964) 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 -- 172.21.15.146:0/2422983341 learned_addr learned my addr 172.21.15.146:0/2422983341 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f3400640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3f40c4b00 0x7fc3f409c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2000640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3f409cd20 0x7fc3f40c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 -- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3f40c4b00 msgr2=0x7fc3f409c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3f40c4b00 0x7fc3f409c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 -- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3f409cd20 msgr2=0x7fc3f40c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3f409cd20 0x7fc3f40c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 -- 172.21.15.146:0/2422983341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40c58b0 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.735+0000 7fc3f2a00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4002aa0 tx=0x7fc3e4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.736+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400fa10 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.736+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e400fb70 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.736+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40133f0 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.736+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f40c5b90 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.736+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4155870 con 0x7fc3d8005130 2024-08-17T02:29:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.737+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f40c5d80 con 0x7fc3d8005130 2024-08-17T02:29:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.738+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc3e4013760 con 0x7fc3d8005130 2024-08-17T02:29:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.738+0000 7fc3ea000640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 0x7fc3d4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.739+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc3e40826e0 con 0x7fc3d8005130 2024-08-17T02:29:31.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.739+0000 7fc3f2000640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 0x7fc3d4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:31.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.739+0000 7fc3f2000640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 0x7fc3d4067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40999a0 tx=0x7fc3e00090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:31.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.742+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc3e4050a50 con 0x7fc3d8005130 2024-08-17T02:29:31.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.917+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3f40c5460 con 0x7fc3d4065180 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.918+0000 7fc3ea000640 1 -- 172.21.15.146:0/2422983341 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3f40c5460 con 0x7fc3d4065180 2024-08-17T02:29:31.918 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 msgr2=0x7fc3d4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 0x7fc3d4067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40999a0 tx=0x7fc3e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 msgr2=0x7fc3f4155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:31.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4002aa0 tx=0x7fc3e4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 shutdown_connections 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fc3d4065180 0x7fc3d4067630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3f40c4b00 0x7fc3f409c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc3f409cd20 0x7fc3f40c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 --2- 172.21.15.146:0/2422983341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d8005130 0x7fc3f4155110 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 >> 172.21.15.146:0/2422983341 conn(0x7fc3f4098e00 msgr2=0x7fc3f4155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 shutdown_connections 2024-08-17T02:29:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:31.920+0000 7fc3f3e00640 1 -- 172.21.15.146:0/2422983341 wait complete. 2024-08-17T02:29:31.935 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:29:31.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:32.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.089+0000 7fd41a400640 1 Processor -- start 2024-08-17T02:29:32.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.089+0000 7fd41a400640 1 -- start start 2024-08-17T02:29:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.090+0000 7fd41a400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4141561c0 0x7fd4140cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.090+0000 7fd41a400640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd414156910 con 0x7fd414152d80 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.090+0000 7fd41a400640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4140cb580 con 0x7fd4140ad170 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.090+0000 7fd41a400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4141565b0 con 0x7fd4141561c0 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413400640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd414152d80 0x7fd4140aca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42494/0 (socket says 172.21.15.146:42494) 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413400640 1 -- 172.21.15.146:0/1044013589 learned_addr learned my addr 172.21.15.146:0/1044013589 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:32.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413e00640 1 --2- 172.21.15.146:0/1044013589 >> v2:172.21.15.150:3300/0 conn(0x7fd4141561c0 0x7fd4140cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd412a00640 1 -- 172.21.15.146:0/1044013589 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971449367 0 0) 0x7fd414156910 con 0x7fd414152d80 2024-08-17T02:29:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd412a00640 1 -- 172.21.15.146:0/1044013589 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f80034e0 con 0x7fd414152d80 2024-08-17T02:29:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413e00640 1 -- 172.21.15.146:0/1044013589 >> v1:172.21.15.150:6789/0 conn(0x7fd4140ad170 legacy=0x7fd414157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413e00640 1 -- 172.21.15.146:0/1044013589 >> v1:172.21.15.146:6789/0 conn(0x7fd414152d80 legacy=0x7fd4140aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.091+0000 7fd413e00640 1 -- 172.21.15.146:0/1044013589 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414153150 con 0x7fd4141561c0 2024-08-17T02:29:32.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.092+0000 7fd413e00640 1 --2- 172.21.15.146:0/1044013589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4141561c0 0x7fd4140cb040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009e60 tx=0x7fd40c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b0727a3995acf32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd412a00640 1 -- 172.21.15.146:0/1044013589 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c007550 con 0x7fd4141561c0 2024-08-17T02:29:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd412a00640 1 -- 172.21.15.146:0/1044013589 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c02d050 con 0x7fd4141561c0 2024-08-17T02:29:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd412a00640 1 -- 172.21.15.146:0/1044013589 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c007900 con 0x7fd4141561c0 2024-08-17T02:29:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 -- 172.21.15.146:0/1044013589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4141561c0 msgr2=0x7fd4140cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 --2- 172.21.15.146:0/1044013589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4141561c0 0x7fd4140cb040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009e60 tx=0x7fd40c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:32.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 -- 172.21.15.146:0/1044013589 shutdown_connections 2024-08-17T02:29:32.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 --2- 172.21.15.146:0/1044013589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4141561c0 0x7fd4140cb040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 -- 172.21.15.146:0/1044013589 >> 172.21.15.146:0/1044013589 conn(0x7fd414067750 msgr2=0x7fd41406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 -- 172.21.15.146:0/1044013589 shutdown_connections 2024-08-17T02:29:32.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.093+0000 7fd41a400640 1 -- 172.21.15.146:0/1044013589 wait complete. 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.095+0000 7fd41a400640 1 Processor -- start 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.095+0000 7fd41a400640 1 -- start start 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 0x7fd4141696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd414152d80 0x7fd41416a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4141561c0 0x7fd414158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140c9bf0 con 0x7fd4140ad170 2024-08-17T02:29:32.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41416abc0 con 0x7fd414152d80 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd41a400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd414157820 con 0x7fd4141561c0 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 0x7fd4141696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 0x7fd4141696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51978/0 (socket says 172.21.15.146:51978) 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 -- 172.21.15.146:0/1939012810 learned_addr learned my addr 172.21.15.146:0/1939012810 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413e00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4141561c0 0x7fd414158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd40aa00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd414152d80 0x7fd41416a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 -- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4141561c0 msgr2=0x7fd414158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4141561c0 0x7fd414158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 -- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd414152d80 msgr2=0x7fd41416a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd414152d80 0x7fd41416a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.096+0000 7fd413400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009a20 con 0x7fd4140ad170 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd413400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 0x7fd4141696c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c5e0 tx=0x7fd404007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404005b70 con 0x7fd4140ad170 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404005cf0 con 0x7fd4140ad170 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404007340 con 0x7fd4140ad170 2024-08-17T02:29:32.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd414157b00 con 0x7fd4140ad170 2024-08-17T02:29:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.097+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4141580c0 con 0x7fd4140ad170 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.098+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4140710c0 con 0x7fd4140ad170 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.099+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd40401b400 con 0x7fd4140ad170 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40b400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd3f0065150 0x7fd3f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd404081c00 con 0x7fd4140ad170 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40aa00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd3f0065150 0x7fd3f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40b400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7fd3f006b040 0x7fd3f006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3f006db00 con 0x7fd3f006b040 2024-08-17T02:29:32.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd404086240 con 0x7fd4140ad170 2024-08-17T02:29:32.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd413e00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7fd3f006b040 0x7fd3f006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.100+0000 7fd40aa00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd3f0065150 0x7fd3f0067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd41414eb20 tx=0x7fd3fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.101+0000 7fd413e00640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7fd3f006b040 0x7fd3f006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.102+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== osd.6 v2:172.21.15.150:6816/37543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd3f006db00 con 0x7fd3f006b040 2024-08-17T02:29:32.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.114+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 --> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4140b0d80 con 0x7fd3f006b040 2024-08-17T02:29:32.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd40b400640 1 -- 172.21.15.146:0/1939012810 <== osd.6 v2:172.21.15.150:6816/37543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd4140b0d80 con 0x7fd3f006b040 2024-08-17T02:29:32.115 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:32.115 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:32.115 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7fd3f006b040 msgr2=0x7fd3f006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.150:6816/37543,v1:172.21.15.150:6817/37543] conn(0x7fd3f006b040 0x7fd3f006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd3f0065150 msgr2=0x7fd3f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fd3f0065150 0x7fd3f0067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd41414eb20 tx=0x7fd3fc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 msgr2=0x7fd4141696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 --2- 172.21.15.146:0/1939012810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4140ad170 0x7fd4141696c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd40400c5e0 tx=0x7fd404007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd413e00640 1 -- 172.21.15.146:0/1939012810 reap_dead start 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 shutdown_connections 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 >> 172.21.15.146:0/1939012810 conn(0x7fd414067750 msgr2=0x7fd4140aca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 shutdown_connections 2024-08-17T02:29:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.115+0000 7fd41a400640 1 -- 172.21.15.146:0/1939012810 wait complete. 2024-08-17T02:29:32.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:29:32.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.279+0000 7f9eba800640 1 Processor -- start 2024-08-17T02:29:32.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.279+0000 7f9eba800640 1 -- start start 2024-08-17T02:29:32.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.280+0000 7f9eba800640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9eb4155180 0x7f9eb40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.280+0000 7f9eba800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40afc10 con 0x7f9eb406e080 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.280+0000 7f9eba800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40af000 con 0x7f9eb4155550 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.280+0000 7f9eba800640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb40af2e0 con 0x7f9eb4155180 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.280+0000 7f9eb3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9eb4155180 0x7f9eb40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9eb406e080 0x7f9eb406e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42496/0 (socket says 172.21.15.146:42496) 2024-08-17T02:29:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb3e00640 1 -- 172.21.15.146:0/2429380543 learned_addr learned my addr 172.21.15.146:0/2429380543 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb3400640 1 -- 172.21.15.146:0/2429380543 >> v1:172.21.15.150:6789/0 conn(0x7f9eb4155550 legacy=0x7f9eb40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb3400640 1 -- 172.21.15.146:0/2429380543 >> v1:172.21.15.146:6789/0 conn(0x7f9eb406e080 legacy=0x7f9eb406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb3400640 1 -- 172.21.15.146:0/2429380543 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb40af5c0 con 0x7f9eb4155180 2024-08-17T02:29:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.281+0000 7f9eb2000640 1 -- 172.21.15.146:0/2429380543 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364471992 0 0) 0x7f9eb40afc10 con 0x7f9eb406e080 2024-08-17T02:29:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.282+0000 7f9eb3400640 1 --2- 172.21.15.146:0/2429380543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb40aea20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400a9f0 tx=0x7f9ea400a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e8bb248b0c90e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.282+0000 7f9eb2000640 1 -- 172.21.15.146:0/2429380543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4030510 con 0x7f9eb4155180 2024-08-17T02:29:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.282+0000 7f9eb2000640 1 -- 172.21.15.146:0/2429380543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea402e050 con 0x7f9eb4155180 2024-08-17T02:29:32.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.282+0000 7f9eb2000640 1 -- 172.21.15.146:0/2429380543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40308a0 con 0x7f9eb4155180 2024-08-17T02:29:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 -- 172.21.15.146:0/2429380543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 msgr2=0x7f9eb40aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 --2- 172.21.15.146:0/2429380543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb40aea20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400a9f0 tx=0x7f9ea400a2b0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 -- 172.21.15.146:0/2429380543 shutdown_connections 2024-08-17T02:29:32.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 --2- 172.21.15.146:0/2429380543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb40aea20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 -- 172.21.15.146:0/2429380543 >> 172.21.15.146:0/2429380543 conn(0x7f9eb40cb9b0 msgr2=0x7f9eb40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 -- 172.21.15.146:0/2429380543 shutdown_connections 2024-08-17T02:29:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.283+0000 7f9eba800640 1 -- 172.21.15.146:0/2429380543 wait complete. 2024-08-17T02:29:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.284+0000 7f9eba800640 1 Processor -- start 2024-08-17T02:29:32.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.284+0000 7f9eba800640 1 -- start start 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb406e080 0x7f9eb4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4155550 0x7f9eb41559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41585c0 con 0x7f9eb4155180 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb4158a50 con 0x7f9eb406e080 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eba800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41579b0 con 0x7f9eb4155550 2024-08-17T02:29:32.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.285+0000 7f9eb2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51996/0 (socket says 172.21.15.146:51996) 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 -- 172.21.15.146:0/1646871132 learned_addr learned my addr 172.21.15.146:0/1646871132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 -- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4155550 msgr2=0x7f9eb41559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4155550 0x7f9eb41559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 -- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb406e080 msgr2=0x7f9eb4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb406e080 0x7f9eb4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 -- 172.21.15.146:0/1646871132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea400a530 con 0x7f9eb4155180 2024-08-17T02:29:32.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eb2a00640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c4c0 tx=0x7f9ea0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011590 con 0x7f9eb4155180 2024-08-17T02:29:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0011710 con 0x7f9eb4155180 2024-08-17T02:29:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0011ad0 con 0x7f9eb4155180 2024-08-17T02:29:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.286+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb4157c90 con 0x7f9eb4155180 2024-08-17T02:29:32.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.287+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb4158250 con 0x7f9eb4155180 2024-08-17T02:29:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.287+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb4064db0 con 0x7f9eb4155180 2024-08-17T02:29:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.288+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ea001b3b0 con 0x7f9eb4155180 2024-08-17T02:29:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.289+0000 7f9eaaa00640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 0x7f9e94067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.289+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9ea0081710 con 0x7f9eb4155180 2024-08-17T02:29:32.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.289+0000 7f9eb3400640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 0x7f9e94067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.290+0000 7f9eb3400640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 0x7f9e94067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4035000 tx=0x7f9ea4038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.293+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ea004f9d0 con 0x7f9eb4155180 2024-08-17T02:29:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.469+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eb40ae5f0 con 0x7f9e94065180 2024-08-17T02:29:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.469+0000 7f9eaaa00640 1 -- 172.21.15.146:0/1646871132 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9eb40ae5f0 con 0x7f9e94065180 2024-08-17T02:29:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:29:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.471+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 msgr2=0x7f9e94067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.471+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 0x7f9e94067630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4035000 tx=0x7f9ea4038000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.471+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 msgr2=0x7f9eb41535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.471+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c4c0 tx=0x7f9ea0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 shutdown_connections 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9e94065180 0x7f9e94067630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb4155180 0x7f9eb41535d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9eb4155550 0x7f9eb41559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 --2- 172.21.15.146:0/1646871132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9eb406e080 0x7f9eb4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 >> 172.21.15.146:0/1646871132 conn(0x7f9eb40cb9b0 msgr2=0x7f9eb40ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 shutdown_connections 2024-08-17T02:29:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.472+0000 7f9eba800640 1 -- 172.21.15.146:0/1646871132 wait complete. 2024-08-17T02:29:32.486 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:29:32.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:29:32.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.640+0000 7fccff600640 1 Processor -- start 2024-08-17T02:29:32.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.640+0000 7fccff600640 1 -- start start 2024-08-17T02:29:32.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccff600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccf8158db0 0x7fccf8159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccff600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80cb4c0 con 0x7fccf80cf290 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccff600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80caec0 con 0x7fccf80caa40 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccff600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80cf770 con 0x7fccf8158db0 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccfcc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccf8158db0 0x7fccf8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccfcc00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fccf8158db0 0x7fccf8159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52004/0 (socket says 172.21.15.146:52004) 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccfcc00640 1 -- 172.21.15.146:0/2277599123 learned_addr learned my addr 172.21.15.146:0/2277599123 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:32.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.641+0000 7fccf7e00640 1 --1- 172.21.15.146:0/2277599123 >> v1:172.21.15.146:6789/0 conn(0x7fccf80cf290 0x7fccf80ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42504/0 (socket says 172.21.15.146:42504) 2024-08-17T02:29:32.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.642+0000 7fccfcc00640 1 -- 172.21.15.146:0/2277599123 >> v1:172.21.15.150:6789/0 conn(0x7fccf80caa40 legacy=0x7fccf80c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.642+0000 7fccfcc00640 1 -- 172.21.15.146:0/2277599123 >> v1:172.21.15.146:6789/0 conn(0x7fccf80cf290 legacy=0x7fccf80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.642+0000 7fccfcc00640 1 -- 172.21.15.146:0/2277599123 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf80cfa50 con 0x7fccf8158db0 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.642+0000 7fccf7400640 1 -- 172.21.15.146:0/2277599123 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356603519 0 0) 0x7fccf80cb4c0 con 0x7fccf80cf290 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.643+0000 7fccfcc00640 1 --2- 172.21.15.146:0/2277599123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf8158db0 0x7fccf8159180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fccec009910 tx=0x7fccec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e096822ff036a2c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.643+0000 7fccf7400640 1 -- 172.21.15.146:0/2277599123 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec02f510 con 0x7fccf8158db0 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.643+0000 7fccf7400640 1 -- 172.21.15.146:0/2277599123 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec02d050 con 0x7fccf8158db0 2024-08-17T02:29:32.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.643+0000 7fccf7400640 1 -- 172.21.15.146:0/2277599123 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec02f8a0 con 0x7fccf8158db0 2024-08-17T02:29:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 -- 172.21.15.146:0/2277599123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf8158db0 msgr2=0x7fccf8159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 --2- 172.21.15.146:0/2277599123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf8158db0 0x7fccf8159180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fccec009910 tx=0x7fccec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 -- 172.21.15.146:0/2277599123 shutdown_connections 2024-08-17T02:29:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 --2- 172.21.15.146:0/2277599123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf8158db0 0x7fccf8159180 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 -- 172.21.15.146:0/2277599123 >> 172.21.15.146:0/2277599123 conn(0x7fccf80cfd90 msgr2=0x7fccf80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 -- 172.21.15.146:0/2277599123 shutdown_connections 2024-08-17T02:29:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.644+0000 7fccff600640 1 -- 172.21.15.146:0/2277599123 wait complete. 2024-08-17T02:29:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.645+0000 7fccff600640 1 Processor -- start 2024-08-17T02:29:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.645+0000 7fccff600640 1 -- start start 2024-08-17T02:29:32.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 0x7fccf81552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccf80cf290 0x7fccf809c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf8158db0 0x7fccf80c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8155810 con 0x7fccf80caa40 2024-08-17T02:29:32.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809d8a0 con 0x7fccf8158db0 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccff600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809cc90 con 0x7fccf80cf290 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.646+0000 7fccfcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 0x7fccf81552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 0x7fccf81552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52012/0 (socket says 172.21.15.146:52012) 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 -- 172.21.15.146:0/1066195537 learned_addr learned my addr 172.21.15.146:0/1066195537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 -- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccf80cf290 msgr2=0x7fccf809c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccf7e00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccf80cf290 0x7fccf809c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfd600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf8158db0 0x7fccf80c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccf80cf290 0x7fccf809c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 -- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf8158db0 msgr2=0x7fccf80c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf8158db0 0x7fccf80c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009450 con 0x7fccf80caa40 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfd600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fccf8158db0 0x7fccf80c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccf7e00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fccf80cf290 0x7fccf809c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.647+0000 7fccfcc00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 0x7fccf81552d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccec009420 tx=0x7fccec035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.648+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec031760 con 0x7fccf80caa40 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.648+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec0318c0 con 0x7fccf80caa40 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.648+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf809cf70 con 0x7fccf80caa40 2024-08-17T02:29:32.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.648+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec031c60 con 0x7fccf80caa40 2024-08-17T02:29:32.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.648+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf809d530 con 0x7fccf80caa40 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.649+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccf80710c0 con 0x7fccf80caa40 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.650+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fccec03c630 con 0x7fccf80caa40 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.650+0000 7fccebe00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fccd8065180 0x7fccd8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.650+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fccec0a3910 con 0x7fccf80caa40 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccf7e00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fccd8065180 0x7fccd8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccebe00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7fccd806b070 0x7fccd806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccd806db30 con 0x7fccd806b070 2024-08-17T02:29:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccec0a3ce0 con 0x7fccf80caa40 2024-08-17T02:29:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccfd600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7fccd806b070 0x7fccd806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.651+0000 7fccf7e00640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fccd8065180 0x7fccd8067630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fccf816ca70 tx=0x7fcce4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.652+0000 7fccfd600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7fccd806b070 0x7fccd806d480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.653+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== osd.7 v2:172.21.15.150:6800/37540 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fccd806db30 con 0x7fccd806b070 2024-08-17T02:29:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.665+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 --> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fccf8067260 con 0x7fccd806b070 2024-08-17T02:29:32.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccebe00640 1 -- 172.21.15.146:0/1066195537 <== osd.7 v2:172.21.15.150:6800/37540 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fccf8067260 con 0x7fccd806b070 2024-08-17T02:29:32.666 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-08-17T02:29:32.666 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:29:32.666 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-08-17T02:29:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7fccd806b070 msgr2=0x7fccd806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccff600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.150:6800/37540,v1:172.21.15.150:6801/37540] conn(0x7fccd806b070 0x7fccd806d480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fccd8065180 msgr2=0x7fccd8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccff600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fccd8065180 0x7fccd8067630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fccf816ca70 tx=0x7fcce4009040 comp rx=0 tx=0).stop 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.666+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 msgr2=0x7fccf81552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccff600640 1 --2- 172.21.15.146:0/1066195537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf80caa40 0x7fccf81552d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccec009420 tx=0x7fccec035000 comp rx=0 tx=0).stop 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccfd600640 1 -- 172.21.15.146:0/1066195537 reap_dead start 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 shutdown_connections 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 >> 172.21.15.146:0/1066195537 conn(0x7fccf80cfd90 msgr2=0x7fccf80c6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 shutdown_connections 2024-08-17T02:29:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.667+0000 7fccff600640 1 -- 172.21.15.146:0/1066195537 wait complete. 2024-08-17T02:29:32.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:29:32.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.832+0000 7f13d9800640 1 Processor -- start 2024-08-17T02:29:32.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.832+0000 7f13d9800640 1 -- start start 2024-08-17T02:29:32.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d9800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13d41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d9800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d4157690 con 0x7f13d4155900 2024-08-17T02:29:32.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d9800640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d4156a80 con 0x7f13d40b0270 2024-08-17T02:29:32.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d9800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4156d60 con 0x7f13d40afdd0 2024-08-17T02:29:32.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d3e00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f13d4155900 0x7f13d4155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42508/0 (socket says 172.21.15.146:42508) 2024-08-17T02:29:32.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d3e00640 1 -- 172.21.15.146:0/1714072535 learned_addr learned my addr 172.21.15.146:0/1714072535 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.833+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13d41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930195013 0 0) 0x7f13d4157690 con 0x7f13d4155900 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b80034e0 con 0x7f13d4155900 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 274902317 0 0) 0x7f13b80034e0 con 0x7f13d4155900 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 msgr2=0x7f13d41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13d41563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 >> v1:172.21.15.150:6789/0 conn(0x7f13d40b0270 legacy=0x7f13d40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4157040 con 0x7f13d4155900 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3669215758 0 0) 0x7f13c4001470 con 0x7f13d4155900 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 >> v1:172.21.15.146:6789/0 conn(0x7f13d4155900 legacy=0x7f13d4155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8003a00 0x7f13b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13b8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8004cc0 0x7f13b8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4156d60 con 0x7f13b8004cc0 2024-08-17T02:29:32.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b800ba80 con 0x7f13b8003a00 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b800bc40 con 0x7f13d40afdd0 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8004cc0 0x7f13b8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13cb400640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13b8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.834+0000 7f13d3e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8003a00 0x7f13b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.835+0000 7f13d8e00640 1 -- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 msgr2=0x7f13b8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.835+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40afdd0 0x7f13b8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.835+0000 7f13d8e00640 1 -- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8003a00 msgr2=0x7f13b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:32.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.835+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8003a00 0x7f13b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.835+0000 7f13d8e00640 1 -- 172.21.15.146:0/1714072535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80034e0 con 0x7f13b8004cc0 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8004cc0 0x7f13b8005130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f13d406b680 tx=0x7f13cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4374f46458df1cb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc031400 con 0x7f13b8004cc0 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00f040 con 0x7f13b8004cc0 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d3400640 1 -- 172.21.15.146:0/1714072535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc031790 con 0x7f13b8004cc0 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d9800640 1 -- 172.21.15.146:0/1714072535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8004cc0 msgr2=0x7f13b8005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d9800640 1 --2- 172.21.15.146:0/1714072535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13b8004cc0 0x7f13b8005130 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f13d406b680 tx=0x7f13cc00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.836+0000 7f13d8e00640 1 -- 172.21.15.146:0/1714072535 reap_dead start 2024-08-17T02:29:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.837+0000 7f13d9800640 1 -- 172.21.15.146:0/1714072535 shutdown_connections 2024-08-17T02:29:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.837+0000 7f13d9800640 1 -- 172.21.15.146:0/1714072535 >> 172.21.15.146:0/1714072535 conn(0x7f13d4067750 msgr2=0x7f13d40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.837+0000 7f13d9800640 1 -- 172.21.15.146:0/1714072535 shutdown_connections 2024-08-17T02:29:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.837+0000 7f13d9800640 1 -- 172.21.15.146:0/1714072535 wait complete. 2024-08-17T02:29:32.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.838+0000 7f13d9800640 1 Processor -- start 2024-08-17T02:29:32.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.838+0000 7f13d9800640 1 -- start start 2024-08-17T02:29:32.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8004cc0 0x7f13d4147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40abc00 0x7f13d40ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c0630 con 0x7f13d40a9b20 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40ac5b0 con 0x7f13b8004cc0 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d9800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40aa8f0 con 0x7f13d40abc00 2024-08-17T02:29:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d8e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52016/0 (socket says 172.21.15.146:52016) 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d8e00640 1 -- 172.21.15.146:0/1161145344 learned_addr learned my addr 172.21.15.146:0/1161145344 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13cb400640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40abc00 0x7f13d40ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.839+0000 7f13d3e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8004cc0 0x7f13d4147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 -- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40abc00 msgr2=0x7f13d40ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40abc00 0x7f13d40ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 -- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8004cc0 msgr2=0x7f13d4147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8004cc0 0x7f13d4147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 -- 172.21.15.146:0/1161145344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40aabd0 con 0x7f13d40a9b20 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d8e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00e210 tx=0x7f13cc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc03c740 con 0x7f13d40a9b20 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc03c8a0 con 0x7f13d40a9b20 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc03cc40 con 0x7f13d40a9b20 2024-08-17T02:29:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.840+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40aaeb0 con 0x7f13d40a9b20 2024-08-17T02:29:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.841+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d40aa490 con 0x7f13d40a9b20 2024-08-17T02:29:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.842+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d40aa6b0 con 0x7f13d40a9b20 2024-08-17T02:29:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.842+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f13cc003030 con 0x7f13d40a9b20 2024-08-17T02:29:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.843+0000 7f13cbe00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 0x7f13b0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.844+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f13cc0a2c10 con 0x7f13d40a9b20 2024-08-17T02:29:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.844+0000 7f13d3e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 0x7f13b0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.844+0000 7f13d3e00640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 0x7f13b0067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f13c40010e0 tx=0x7f13d4157600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:32.848+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f13d40aa6b0 con 0x7f13d40a9b20 2024-08-17T02:29:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.022+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f13d40c07e0 con 0x7f13b0065180 2024-08-17T02:29:33.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.022+0000 7f13cbe00640 1 -- 172.21.15.146:0/1161145344 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f13d40c07e0 con 0x7f13b0065180 2024-08-17T02:29:33.024 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:29:33.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 msgr2=0x7f13b0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 0x7f13b0067630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f13c40010e0 tx=0x7f13d4157600 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 msgr2=0x7f13d40a9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00e210 tx=0x7f13cc036000 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 shutdown_connections 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f13b0065180 0x7f13b0067630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13d40a9b20 0x7f13d40a9f50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f13d40abc00 0x7f13d40ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 --2- 172.21.15.146:0/1161145344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13b8004cc0 0x7f13d4147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 >> 172.21.15.146:0/1161145344 conn(0x7f13d4067750 msgr2=0x7f13d4069280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 shutdown_connections 2024-08-17T02:29:33.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.025+0000 7f13d9800640 1 -- 172.21.15.146:0/1161145344 wait complete. 2024-08-17T02:29:33.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:33.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.188+0000 7fb9fc600640 1 Processor -- start 2024-08-17T02:29:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.188+0000 7fb9fc600640 1 -- start start 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.189+0000 7fb9fc600640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f406df00 0x7fb9f40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.189+0000 7fb9fc600640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f4156670 con 0x7fb9f4155df0 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9fc600640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f406e5e0 con 0x7fb9f4155a20 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9fc600640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40b0350 con 0x7fb9f406df00 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f406df00 0x7fb9f40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9f406df00 0x7fb9f40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52020/0 (socket says 172.21.15.146:52020) 2024-08-17T02:29:33.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 -- 172.21.15.146:0/3765141716 learned_addr learned my addr 172.21.15.146:0/3765141716 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:33.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9fa600640 1 --1- 172.21.15.146:0/3765141716 >> v1:172.21.15.146:6789/0 conn(0x7fb9f4155df0 0x7fb9f4156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42520/0 (socket says 172.21.15.146:42520) 2024-08-17T02:29:33.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 -- 172.21.15.146:0/3765141716 >> v1:172.21.15.150:6789/0 conn(0x7fb9f4155a20 legacy=0x7fb9f406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 -- 172.21.15.146:0/3765141716 >> v1:172.21.15.146:6789/0 conn(0x7fb9f4155df0 legacy=0x7fb9f4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f9200640 1 -- 172.21.15.146:0/3765141716 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f406e8c0 con 0x7fb9f406df00 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.190+0000 7fb9f3e00640 1 -- 172.21.15.146:0/3765141716 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208384756 0 0) 0x7fb9f4156670 con 0x7fb9f4155df0 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.191+0000 7fb9f9200640 1 --2- 172.21.15.146:0/3765141716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f406df00 0x7fb9f40adf10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009910 tx=0x7fb9e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a1c602a11a4e36 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9f3e00640 1 -- 172.21.15.146:0/3765141716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e002ae60 con 0x7fb9f406df00 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9f3e00640 1 -- 172.21.15.146:0/3765141716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0032440 con 0x7fb9f406df00 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9f3e00640 1 -- 172.21.15.146:0/3765141716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00327e0 con 0x7fb9f406df00 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 -- 172.21.15.146:0/3765141716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f406df00 msgr2=0x7fb9f40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 --2- 172.21.15.146:0/3765141716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f406df00 0x7fb9f40adf10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009910 tx=0x7fb9e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 -- 172.21.15.146:0/3765141716 shutdown_connections 2024-08-17T02:29:33.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 --2- 172.21.15.146:0/3765141716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f406df00 0x7fb9f40adf10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 -- 172.21.15.146:0/3765141716 >> 172.21.15.146:0/3765141716 conn(0x7fb9f40cb9b0 msgr2=0x7fb9f40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 -- 172.21.15.146:0/3765141716 shutdown_connections 2024-08-17T02:29:33.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.192+0000 7fb9fc600640 1 -- 172.21.15.146:0/3765141716 wait complete. 2024-08-17T02:29:33.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.194+0000 7fb9fc600640 1 Processor -- start 2024-08-17T02:29:33.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.194+0000 7fb9fc600640 1 -- start start 2024-08-17T02:29:33.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 0x7fb9f414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 0x7fb9f40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40c1450 con 0x7fb9f4155df0 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40c1730 con 0x7fb9f4155a20 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fc600640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40c1a10 con 0x7fb9f406df00 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52024/0 (socket says 172.21.15.146:52024) 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 -- 172.21.15.146:0/346441359 learned_addr learned my addr 172.21.15.146:0/346441359 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9f9200640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 0x7fb9f40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9f9c00640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 0x7fb9f414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 -- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 msgr2=0x7fb9f414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 0x7fb9f414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 -- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 msgr2=0x7fb9f40acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 0x7fb9f40acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9fa600640 1 -- 172.21.15.146:0/346441359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0009450 con 0x7fb9f4155df0 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9f9200640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 0x7fb9f40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.195+0000 7fb9f9c00640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 0x7fb9f414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9fa600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00cb90 tx=0x7fb9ec001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec004d10 con 0x7fb9f4155df0 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec004e70 con 0x7fb9f4155df0 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00a8c0 con 0x7fb9f4155df0 2024-08-17T02:29:33.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f40c1cf0 con 0x7fb9f4155df0 2024-08-17T02:29:33.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.196+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f414fb00 con 0x7fb9f4155df0 2024-08-17T02:29:33.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.197+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f40aa8b0 con 0x7fb9f4155df0 2024-08-17T02:29:33.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.198+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb9ec00acf0 con 0x7fb9f4155df0 2024-08-17T02:29:33.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.199+0000 7fb9f0c00640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 0x7fb9d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:33.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.199+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb9ec082100 con 0x7fb9f4155df0 2024-08-17T02:29:33.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.199+0000 7fb9f9c00640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 0x7fb9d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:33.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.200+0000 7fb9f9c00640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 0x7fb9d4067600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80017a0 tx=0x7fb9e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:33.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.203+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb9ec053f70 con 0x7fb9f4155df0 2024-08-17T02:29:33.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.372+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9f4064db0 con 0x7fb9d4065150 2024-08-17T02:29:33.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.374+0000 7fb9f0c00640 1 -- 172.21.15.146:0/346441359 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50514 (secure 0 0 0) 0x7fb9f4064db0 con 0x7fb9d4065150 2024-08-17T02:29:33.375 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:33.376 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 msgr2=0x7fb9d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 0x7fb9d4067600 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80017a0 tx=0x7fb9e8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 msgr2=0x7fb9f40c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00cb90 tx=0x7fb9ec001810 comp rx=0 tx=0).stop 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 shutdown_connections 2024-08-17T02:29:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7fb9d4065150 0x7fb9d4067600 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9f4155df0 0x7fb9f40c2380 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9f4155a20 0x7fb9f40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 --2- 172.21.15.146:0/346441359 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9f406df00 0x7fb9f414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 >> 172.21.15.146:0/346441359 conn(0x7fb9f40cb9b0 msgr2=0x7fb9f4154120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 shutdown_connections 2024-08-17T02:29:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:33.376+0000 7fb9fc600640 1 -- 172.21.15.146:0/346441359 wait complete. 2024-08-17T02:29:33.392 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:29:32.376869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388188,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586532,"statfs":{"total":773094113280,"available":770648608768,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001777"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":186,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:29:21.821589+0000","last_change":"2024-08-17T02:25:51.939898+0000","last_active":"2024-08-17T02:29:21.821589+0000","last_peered":"2024-08-17T02:29:21.821589+0000","last_clean":"2024-08-17T02:29:21.821589+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:29:21.821589+0000","last_undegraded":"2024-08-17T02:29:21.821589+0000","last_fullsized":"2024-08-17T02:29:21.821589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:50.498135+0000","last_clean_scrub_stamp":"2024-08-17T02:25:50.498135+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.216583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.629,"15min":0.59999999999999998},"min":{"1min":0.56299999999999994,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":0.93899999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.755,"15min":0.749},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.622},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.58799999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.95799999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.23,"15min":1.23},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93000000000000005,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.435,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78100000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83499999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88300000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":1.115,"15min":1.115},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73199999999999998,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":1.135,"15min":1.135},"last":0.69999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69199999999999995},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.86499999999999999,"5min":3.569,"15min":3.569},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":2.016,"15min":2.016},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.872,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.629}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93999999999999995,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.67100000000000004,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92000000000000004,"5min":2.052,"15min":2.052},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.88400000000000001,"5min":1.607,"15min":1.607},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.72099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.65800000000000003,"15min":0.61199999999999999},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83899999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.91600000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":1.266,"15min":1.266},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69799999999999995,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.70599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.86199999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":1.161,"15min":1.161},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.876}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.208,"15min":1.208},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":1.3,"15min":1.3},"last":0.91600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.56699999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90400000000000003,"5min":1.623,"15min":1.623},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.62,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98899999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.621,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.661,"15min":1.661},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92400000000000004,"5min":1.758,"15min":1.758},"last":0.61399999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.44,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77700000000000002,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.78300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85399999999999998,"5min":1.087,"15min":1.087},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0129999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.70699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":3.226,"15min":3.226},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.53600000000000003,"15min":0.57399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.47899999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.901,"15min":1.901},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":2.75,"15min":2.75},"last":0.439}]},{"osd":4,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.081,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.94299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1020000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.873}]},{"osd":5,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.0580000000000001,"5min":3.581,"15min":3.581},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.153,"5min":3.157,"15min":3.157},"last":0.77600000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.117,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.91800000000000004,"15min":0.95499999999999996},"min":{"1min":0.69299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1339999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.002,"5min":3.496,"15min":3.496},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.98699999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0329999999999999,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.52300000000000002},"min":{"1min":0.32600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.624,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67600000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.907,"15min":1.907},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.77200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":5.577,"15min":5.577},"last":0.45800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.375}]},{"osd":4,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.05,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.90600000000000003},"min":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97499999999999998,"5min":3.226,"15min":3.226},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94199999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.90100000000000002},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0649999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85599999999999998,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":3.028,"15min":3.028},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0780000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.37}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.621,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.68100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0149999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77100000000000002},"min":{"1min":0.59399999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.083,"15min":1.083},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.76600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.024,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.37},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.40899999999999997},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.753,"15min":0.753},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.505,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.96699999999999997,"5min":1.288,"15min":1.288},"last":0.53800000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":1.208,"15min":1.208},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.61099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94499999999999995,"5min":1.135,"15min":1.135},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.77100000000000002},"min":{"1min":0.67300000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.95499999999999996,"5min":1.448,"15min":1.448},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96399999999999997,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:33.396 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:25:50.498135+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=25, tm_sec=50, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=27, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:29:33.396 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:29:53.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:53.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.557+0000 7f1965800640 1 Processor -- start 2024-08-17T02:29:53.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.557+0000 7f1965800640 1 -- start start 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.558+0000 7f1965800640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f19600cbea0 0x7f1960156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.558+0000 7f1965800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f19601577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1965800640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19600cc300 con 0x7f1960156ad0 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1965800640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19600ca900 con 0x7f19600cbea0 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1965800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19600cc560 con 0x7f196006dc80 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f195fe00640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1960156ad0 0x7f196006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52890/0 (socket says 172.21.15.146:52890) 2024-08-17T02:29:53.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f195fe00640 1 -- 172.21.15.146:0/3625612434 learned_addr learned my addr 172.21.15.146:0/3625612434 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1964e00640 1 --2- 172.21.15.146:0/3625612434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f19601577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1957400640 1 --2- 172.21.15.146:0/3625612434 >> v2:172.21.15.150:3300/0 conn(0x7f19600cbea0 0x7f1960156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786118348 0 0) 0x7f19600cc300 con 0x7f1960156ad0 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19440034e0 con 0x7f1960156ad0 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1964e00640 1 -- 172.21.15.146:0/3625612434 >> v2:172.21.15.150:3300/0 conn(0x7f19600cbea0 msgr2=0x7f1960156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f1964e00640 1 --2- 172.21.15.146:0/3625612434 >> v2:172.21.15.150:3300/0 conn(0x7f19600cbea0 0x7f1960156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.559+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3399755785 0 0) 0x7f19440034e0 con 0x7f1960156ad0 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.560+0000 7f1964e00640 1 -- 172.21.15.146:0/3625612434 >> v1:172.21.15.146:6789/0 conn(0x7f1960156ad0 legacy=0x7f196006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.560+0000 7f1964e00640 1 -- 172.21.15.146:0/3625612434 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600caaf0 con 0x7f196006dc80 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1964e00640 1 --2- 172.21.15.146:0/3625612434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f19601577f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1958009e60 tx=0x7f1958009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1659ba246030d4a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950001490 con 0x7f196006dc80 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195802d050 con 0x7f196006dc80 2024-08-17T02:29:53.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f195f400640 1 -- 172.21.15.146:0/3625612434 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958031630 con 0x7f196006dc80 2024-08-17T02:29:53.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1965800640 1 -- 172.21.15.146:0/3625612434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 msgr2=0x7f19601577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1965800640 1 --2- 172.21.15.146:0/3625612434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f19601577f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1958009e60 tx=0x7f1958009780 comp rx=0 tx=0).stop 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1965800640 1 -- 172.21.15.146:0/3625612434 shutdown_connections 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1965800640 1 --2- 172.21.15.146:0/3625612434 >> v2:172.21.15.150:3300/0 conn(0x7f19600cbea0 0x7f1960156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.561+0000 7f1965800640 1 --2- 172.21.15.146:0/3625612434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f19601577f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.562+0000 7f1965800640 1 -- 172.21.15.146:0/3625612434 >> 172.21.15.146:0/3625612434 conn(0x7f1960067750 msgr2=0x7f19600cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.562+0000 7f1965800640 1 -- 172.21.15.146:0/3625612434 shutdown_connections 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.562+0000 7f1965800640 1 -- 172.21.15.146:0/3625612434 wait complete. 2024-08-17T02:29:53.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.563+0000 7f1965800640 1 Processor -- start 2024-08-17T02:29:53.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.563+0000 7f1965800640 1 -- start start 2024-08-17T02:29:53.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f1960159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600cbea0 0x7f196015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196015c5a0 con 0x7f1960156ad0 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196015b990 con 0x7f19600cbea0 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1965800640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196015bc70 con 0x7f196006dc80 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1964e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1964e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54142/0 (socket says 172.21.15.146:54142) 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1964e00640 1 -- 172.21.15.146:0/2844271987 learned_addr learned my addr 172.21.15.146:0/2844271987 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:53.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f195fe00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f1960159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.564+0000 7f1957400640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600cbea0 0x7f196015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 -- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 msgr2=0x7f1960159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f1960159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 -- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600cbea0 msgr2=0x7f196015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600cbea0 0x7f196015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 -- 172.21.15.146:0/2844271987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009a20 con 0x7f1960156ad0 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1964e00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19580099f0 tx=0x7f1958037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195803ba70 con 0x7f1960156ad0 2024-08-17T02:29:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958040070 con 0x7f1960156ad0 2024-08-17T02:29:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195803be60 con 0x7f1960156ad0 2024-08-17T02:29:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.565+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196015bf50 con 0x7f1960156ad0 2024-08-17T02:29:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.566+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196015a370 con 0x7f1960156ad0 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.567+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196015c750 con 0x7f1960156ad0 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.567+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1958046640 con 0x7f1960156ad0 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.568+0000 7f1957e00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.568+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1958042070 con 0x7f1960156ad0 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.568+0000 7f195fe00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.569+0000 7f195fe00640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19500015c0 tx=0x7f1950001a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.573+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f196015c750 con 0x7f1960156ad0 2024-08-17T02:29:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.740+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 --> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1960071050 con 0x7f193c065150 2024-08-17T02:29:53.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.742+0000 7f1957e00640 1 -- 172.21.15.146:0/2844271987 <== mgr.4101 v2:172.21.15.146:6832/36852 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50509 (secure 0 0 0) 0x7f1960071050 con 0x7f193c065150 2024-08-17T02:29:53.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-08-17T02:29:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 msgr2=0x7f193c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19500015c0 tx=0x7f1950001a50 comp rx=0 tx=0).stop 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 msgr2=0x7f1960141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f19580099f0 tx=0x7f1958037000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 shutdown_connections 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f193c065150 0x7f193c067600 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1960156ad0 0x7f1960141140 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19600cbea0 0x7f196015ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 --2- 172.21.15.146:0/2844271987 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f196006dc80 0x7f1960159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 >> 172.21.15.146:0/2844271987 conn(0x7f1960067750 msgr2=0x7f19600ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 shutdown_connections 2024-08-17T02:29:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.744+0000 7f1965800640 1 -- 172.21.15.146:0/2844271987 wait complete. 2024-08-17T02:29:53.760 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-08-17T02:29:52.380835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388172,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586548,"statfs":{"total":773094113280,"available":770648625152,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002637"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":199,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:29:33.835496+0000","last_change":"2024-08-17T02:29:33.835464+0000","last_active":"2024-08-17T02:29:33.835496+0000","last_peered":"2024-08-17T02:29:33.835496+0000","last_clean":"2024-08-17T02:29:33.835496+0000","last_became_active":"2024-08-17T02:25:51.938630+0000","last_became_peered":"2024-08-17T02:25:51.938630+0000","last_unstale":"2024-08-17T02:29:33.835496+0000","last_undegraded":"2024-08-17T02:29:33.835496+0000","last_fullsized":"2024-08-17T02:29:33.835496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:29:33.835352+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:29:33.835352+0000","last_clean_scrub_stamp":"2024-08-17T02:29:33.835352+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:13.567185+0000","scrub_duration":0.0071667079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.629,"15min":0.59999999999999998},"min":{"1min":0.56299999999999994,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.629,"15min":0.60199999999999998},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":0.93899999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.74099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.755,"15min":0.749},"min":{"1min":0.57799999999999996,"5min":0.501,"15min":0.501},"max":{"1min":0.97399999999999998,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.58799999999999997,"5min":0.442,"15min":0.442},"max":{"1min":0.95799999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.66800000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67300000000000004,"15min":0.65500000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.69099999999999995,"15min":0.68300000000000005},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.495}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.72099999999999997,"15min":0.71799999999999997},"min":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.23,"15min":1.23},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.746,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93000000000000005,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.67400000000000004,"15min":0.71499999999999997},"min":{"1min":0.435,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78100000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.83499999999999996,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.63},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.51200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88300000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.753},"min":{"1min":0.48899999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":1.115,"15min":1.115},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73199999999999998,"15min":0.76300000000000001},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.94299999999999995,"5min":1.135,"15min":1.135},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.69199999999999995},"min":{"1min":0.54400000000000004,"5min":0.438,"15min":0.438},"max":{"1min":0.86499999999999999,"5min":3.569,"15min":3.569},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68400000000000005,"15min":0.67400000000000004},"min":{"1min":0.52400000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81200000000000006,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":2.016,"15min":2.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.746},"min":{"1min":0.53300000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.872,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.72199999999999998},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83999999999999997,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51300000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93999999999999995,"5min":3.6480000000000001,"15min":3.6480000000000001},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70799999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85499999999999998,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.749,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89400000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.70399999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.72899999999999998,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83899999999999997,"5min":3.6829999999999998,"15min":3.6829999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.67100000000000004,"15min":0.71099999999999997},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78500000000000003,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69799999999999995,"15min":0.71799999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92000000000000004,"5min":2.052,"15min":2.052},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.78700000000000003,"15min":0.81299999999999994},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.90400000000000003,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72499999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.88400000000000001,"5min":1.607,"15min":1.607},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81499999999999995,"15min":0.82999999999999996},"min":{"1min":0.61699999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.73999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.65800000000000003,"15min":0.61199999999999999},"min":{"1min":0.58699999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.93999999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.83899999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68700000000000006,"15min":0.67500000000000004},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.91600000000000004,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71499999999999997,"15min":0.69699999999999995},"min":{"1min":0.57799999999999996,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":1.266,"15min":1.266},"last":0.875}]},{"osd":3,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69799999999999995,"15min":0.67000000000000004},"min":{"1min":0.55300000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94799999999999995,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.70599999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":1.339,"15min":1.339},"last":0.89100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":1.161,"15min":1.161},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66300000000000003,"15min":0.67300000000000004},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85199999999999998,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.46100000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.208,"15min":1.208},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89800000000000002,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:53 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.70299999999999996,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.75},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.46600000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95499999999999996,"5min":1.3,"15min":1.3},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94699999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66400000000000003,"15min":0.63200000000000001},"min":{"1min":0.56699999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90400000000000003,"5min":1.623,"15min":1.623},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69199999999999995,"15min":0.67700000000000005},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.97199999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.69299999999999995,"15min":0.66700000000000004},"min":{"1min":0.62,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.98899999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72499999999999998,"15min":0.71299999999999997},"min":{"1min":0.621,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.661,"15min":1.661},"last":0.876},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.55100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92400000000000004,"5min":1.758,"15min":1.758},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.44,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77700000000000002,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.375,"15min":0.375},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85399999999999998,"5min":1.087,"15min":1.087},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68700000000000006,"15min":0.70899999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0129999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.55500000000000005},"min":{"1min":0.32900000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":3.226,"15min":3.226},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65900000000000003,"5min":3.4660000000000002,"15min":3.4660000000000002},"last":0.497}]},{"osd":1,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.53600000000000003,"15min":0.57399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64000000000000001,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.56899999999999995,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73199999999999998,"5min":3.1960000000000002,"15min":3.1960000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.901,"15min":1.901},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.68200000000000005},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74199999999999999,"5min":2.75,"15min":2.75},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.081,"5min":3.4039999999999999,"15min":3.4039999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.94299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1020000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.68500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93500000000000005,"15min":0.97399999999999998},"min":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.0580000000000001,"5min":3.581,"15min":3.581},"last":0.747},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.67900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.153,"5min":3.157,"15min":3.157},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.54300000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.117,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.87,"5min":0.91800000000000004,"15min":0.95499999999999996},"min":{"1min":0.69299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1339999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:58 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.91900000000000004,"15min":0.97099999999999997},"min":{"1min":0.65400000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.002,"5min":3.496,"15min":3.496},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.98699999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0329999999999999,"5min":3.6110000000000002,"15min":3.6110000000000002},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.52300000000000002},"min":{"1min":0.32600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.624,"5min":2.9020000000000001,"15min":2.9020000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52800000000000002},"min":{"1min":0.34799999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.67600000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.56499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58499999999999996,"5min":1.907,"15min":1.907},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.77200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":5.577,"15min":5.577},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76800000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.61299999999999999,"15min":0.65600000000000003},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71699999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.05,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.78500000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.85999999999999999,"15min":0.90600000000000003},"min":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97499999999999998,"5min":3.226,"15min":3.226},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94199999999999995,"5min":2.9990000000000001,"15min":2.9990000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.90100000000000002},"min":{"1min":0.57099999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0649999999999999,"5min":3.2629999999999999,"15min":3.2629999999999999},"last":0.94699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.85599999999999998,"15min":0.873},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":3.028,"15min":3.028},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.63700000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0780000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.42999999999999999},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.34699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67200000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"min":{"1min":0.36399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.621,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.441},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.67000000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70599999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56699999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.0149999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.79200000000000004},"min":{"1min":0.64000000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91300000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77300000000000002},"min":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.91900000000000004,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.95099999999999996,"5min":1.129,"15min":1.129},"last":0.752}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77100000000000002},"min":{"1min":0.59399999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.083,"15min":1.083},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.79900000000000004},"min":{"1min":0.61399999999999999,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.67900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.96399999999999997,"5min":1.29,"15min":1.29},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.63100000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.024,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.56499999999999995,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.40899999999999997},"min":{"1min":0.33500000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70799999999999996,"5min":0.753,"15min":0.753},"last":0.36199999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.505,"15min":0.48499999999999999},"min":{"1min":0.41599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.49399999999999999},"min":{"1min":0.45000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.71799999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.46300000000000002,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92900000000000005,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.70699999999999996,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.96699999999999997,"5min":1.288,"15min":1.288},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.621,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93400000000000005,"5min":1.208,"15min":1.208},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.70499999999999996},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.61099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.75900000000000001,"15min":0.74099999999999999},"min":{"1min":0.629,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.94499999999999995,"5min":1.135,"15min":1.135},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78900000000000003,"15min":0.77100000000000002},"min":{"1min":0.67300000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.95499999999999996,"5min":1.448,"15min":1.448},"last":1.117},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.77500000000000002,"15min":0.753},"min":{"1min":0.69899999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96399999999999997,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.1990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:53.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:29:53.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.906+0000 7f35b3400640 1 Processor -- start 2024-08-17T02:29:53.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.906+0000 7f35b3400640 1 -- start start 2024-08-17T02:29:53.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f35ac0abb00 0x7f35ac0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0ab130 con 0x7f35ac0adcf0 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0ae5a0 con 0x7f35ac0abb00 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.907+0000 7f35b3400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0ae2c0 con 0x7f35ac156c50 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54146/0 (socket says 172.21.15.146:54146) 2024-08-17T02:29:53.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 -- 172.21.15.146:0/2410832144 learned_addr learned my addr 172.21.15.146:0/2410832144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35b1400640 1 --2- 172.21.15.146:0/2410832144 >> v2:172.21.15.150:3300/0 conn(0x7f35ac0abb00 0x7f35ac0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35b0a00640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 -- 172.21.15.146:0/2410832144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 msgr2=0x7f35ac0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 -- 172.21.15.146:0/2410832144 >> v2:172.21.15.150:3300/0 conn(0x7f35ac0abb00 msgr2=0x7f35ac0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 --2- 172.21.15.146:0/2410832144 >> v2:172.21.15.150:3300/0 conn(0x7f35ac0abb00 0x7f35ac0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.908+0000 7f35abe00640 1 -- 172.21.15.146:0/2410832144 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0aaae0 con 0x7f35ac0adcf0 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.909+0000 7f35abe00640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06ef40 tx=0x7f35980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924b5a52d902f699 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.909+0000 7f35ab400640 1 -- 172.21.15.146:0/2410832144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359802ad40 con 0x7f35ac0adcf0 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35ab400640 1 -- 172.21.15.146:0/2410832144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598032440 con 0x7f35ac0adcf0 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35ab400640 1 -- 172.21.15.146:0/2410832144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359802aea0 con 0x7f35ac0adcf0 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 -- 172.21.15.146:0/2410832144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0adcf0 msgr2=0x7f35ac0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06ef40 tx=0x7f35980091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 -- 172.21.15.146:0/2410832144 shutdown_connections 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 --2- 172.21.15.146:0/2410832144 >> v2:172.21.15.150:3300/0 conn(0x7f35ac0abb00 0x7f35ac0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0adcf0 0x7f35ac0ab5c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 --2- 172.21.15.146:0/2410832144 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 -- 172.21.15.146:0/2410832144 >> 172.21.15.146:0/2410832144 conn(0x7f35ac067750 msgr2=0x7f35ac0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 -- 172.21.15.146:0/2410832144 shutdown_connections 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.910+0000 7f35b3400640 1 -- 172.21.15.146:0/2410832144 wait complete. 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.912+0000 7f35b3400640 1 Processor -- start 2024-08-17T02:29:53.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.912+0000 7f35b3400640 1 -- start start 2024-08-17T02:29:53.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 0x7f35ac15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac15af40 con 0x7f35ac0abb00 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac15c6b0 con 0x7f35ac0adcf0 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b3400640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac15a610 con 0x7f35ac156c50 2024-08-17T02:29:53.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54148/0 (socket says 172.21.15.146:54148) 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 -- 172.21.15.146:0/1794389208 learned_addr learned my addr 172.21.15.146:0/1794389208 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35abe00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 0x7f35ac15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b1400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 -- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 msgr2=0x7f35ac06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac06dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 -- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 msgr2=0x7f35ac15bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 0x7f35ac15bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35b0a00640 1 -- 172.21.15.146:0/1794389208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009450 con 0x7f35ac0abb00 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.913+0000 7f35abe00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 0x7f35ac15bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f35b0a00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e900 tx=0x7f35a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000c8e0 con 0x7f35ac0abb00 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000ca40 con 0x7f35ac0abb00 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac15a8f0 con 0x7f35ac0abb00 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000cde0 con 0x7f35ac0abb00 2024-08-17T02:29:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.914+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac15a130 con 0x7f35ac0abb00 2024-08-17T02:29:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.915+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac071050 con 0x7f35ac0abb00 2024-08-17T02:29:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.916+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f35a0013680 con 0x7f35ac0abb00 2024-08-17T02:29:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.916+0000 7f359fe00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 0x7f358c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.917+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f35a0082420 con 0x7f35ac0abb00 2024-08-17T02:29:53.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.917+0000 7f35abe00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 0x7f358c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.918+0000 7f35abe00640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 0x7f358c067630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f3598032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:53.921+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f35a00506e0 con 0x7f35ac0abb00 2024-08-17T02:29:54.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.093+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f35ac153930 con 0x7f35ac0abb00 2024-08-17T02:29:54.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.099+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f35a00506e0 con 0x7f35ac0abb00 2024-08-17T02:29:54.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.100+0000 7f359fe00640 1 -- 172.21.15.146:0/1794389208 <== mon.0 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f35a0053d00 con 0x7f35ac0abb00 2024-08-17T02:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 msgr2=0x7f358c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 0x7f358c067630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f3598032000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 msgr2=0x7f35ac15b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e900 tx=0x7f35a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 shutdown_connections 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f358c065180 0x7f358c067630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35ac156c50 0x7f35ac06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35ac0adcf0 0x7f35ac15bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 --2- 172.21.15.146:0/1794389208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35ac0abb00 0x7f35ac15b3d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.102+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 >> 172.21.15.146:0/1794389208 conn(0x7f35ac067750 msgr2=0x7f35ac0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.103+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 shutdown_connections 2024-08-17T02:29:54.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.103+0000 7f35b3400640 1 -- 172.21.15.146:0/1794389208 wait complete. 2024-08-17T02:29:54.119 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:54.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:54.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.267+0000 7f9f11e00640 1 Processor -- start 2024-08-17T02:29:54.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.267+0000 7f9f11e00640 1 -- start start 2024-08-17T02:29:54.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.268+0000 7f9f11e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 0x7f9f0c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.268+0000 7f9f11e00640 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0afc10 con 0x7f9f0c155550 2024-08-17T02:29:54.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.268+0000 7f9f11e00640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0af000 con 0x7f9f0c06e080 2024-08-17T02:29:54.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.268+0000 7f9f11e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0af2e0 con 0x7f9f0c155180 2024-08-17T02:29:54.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0a000640 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9f0c155550 0x7f9f0c0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52898/0 (socket says 172.21.15.146:52898) 2024-08-17T02:29:54.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0a000640 1 -- 172.21.15.146:0/1289724869 learned_addr learned my addr 172.21.15.146:0/1289724869 (peer_addr_for_me v1:172.21.15.146:0/0) 2024-08-17T02:29:54.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0aa00640 1 --2- 172.21.15.146:0/1289724869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 0x7f9f0c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373504451 0 0) 0x7f9f0c0afc10 con 0x7f9f0c155550 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef00045f0 con 0x7f9f0c155550 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499316758 0 0) 0x7f9f0c0af000 con 0x7f9f0c06e080 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f0c0afc10 con 0x7f9f0c06e080 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0aa00640 1 -- 172.21.15.146:0/1289724869 >> v1:172.21.15.150:6789/0 conn(0x7f9f0c06e080 legacy=0x7f9f0c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0aa00640 1 -- 172.21.15.146:0/1289724869 >> v1:172.21.15.146:6789/0 conn(0x7f9f0c155550 legacy=0x7f9f0c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.269+0000 7f9f0aa00640 1 -- 172.21.15.146:0/1289724869 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0af5c0 con 0x7f9f0c155180 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f0aa00640 1 --2- 172.21.15.146:0/1289724869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 0x7f9f0c0aea20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009880 tx=0x7f9efc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2887e08b3f63066 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc02ae10 con 0x7f9f0c155180 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9efc032440 con 0x7f9f0c155180 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f09600640 1 -- 172.21.15.146:0/1289724869 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0327c0 con 0x7f9f0c155180 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f11e00640 1 -- 172.21.15.146:0/1289724869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 msgr2=0x7f9f0c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f11e00640 1 --2- 172.21.15.146:0/1289724869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 0x7f9f0c0aea20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009880 tx=0x7f9efc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f11e00640 1 -- 172.21.15.146:0/1289724869 shutdown_connections 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f11e00640 1 --2- 172.21.15.146:0/1289724869 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c155180 0x7f9f0c0aea20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.271+0000 7f9f11e00640 1 -- 172.21.15.146:0/1289724869 >> 172.21.15.146:0/1289724869 conn(0x7f9f0c0cb9b0 msgr2=0x7f9f0c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.272+0000 7f9f11e00640 1 -- 172.21.15.146:0/1289724869 shutdown_connections 2024-08-17T02:29:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.272+0000 7f9f11e00640 1 -- 172.21.15.146:0/1289724869 wait complete. 2024-08-17T02:29:54.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.273+0000 7f9f11e00640 1 Processor -- start 2024-08-17T02:29:54.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.273+0000 7f9f11e00640 1 -- start start 2024-08-17T02:29:54.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c06e080 0x7f9f0c069130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 0x7f9f0c167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c14e600 con 0x7f9f0c155180 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c14f130 con 0x7f9f0c155550 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f11e00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c14da70 con 0x7f9f0c06e080 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54158/0 (socket says 172.21.15.146:54158) 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 -- 172.21.15.146:0/3757089625 learned_addr learned my addr 172.21.15.146:0/3757089625 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-08-17T02:29:54.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0b400640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 0x7f9f0c167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0aa00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c06e080 0x7f9f0c069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 -- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c06e080 msgr2=0x7f9f0c069130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c06e080 0x7f9f0c069130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 -- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 msgr2=0x7f9f0c167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 0x7f9f0c167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0a000640 1 -- 172.21.15.146:0/3757089625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009390 con 0x7f9f0c155180 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.274+0000 7f9f0b400640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 0x7f9f0c167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f0a000640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c5b0 tx=0x7f9ef8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8005b70 con 0x7f9f0c155180 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9ef8005cd0 con 0x7f9f0c155180 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c14dd50 con 0x7f9f0c155180 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8007360 con 0x7f9f0c155180 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.275+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c14edc0 con 0x7f9f0c155180 2024-08-17T02:29:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.276+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c14f2e0 con 0x7f9f0c155180 2024-08-17T02:29:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.277+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ef801b400 con 0x7f9f0c155180 2024-08-17T02:29:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.278+0000 7f9f02000640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 0x7f9eec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.278+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9ef8081d60 con 0x7f9f0c155180 2024-08-17T02:29:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.278+0000 7f9f0aa00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 0x7f9eec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.278+0000 7f9f0aa00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 0x7f9eec067600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9efc034000 tx=0x7f9efc0090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.281+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9f0c14f2e0 con 0x7f9f0c155180 2024-08-17T02:29:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.487+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f0c14f2a0 con 0x7f9f0c155180 2024-08-17T02:29:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.487+0000 7f9f02000640 1 -- 172.21.15.146:0/3757089625 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f9ef8050120 con 0x7f9f0c155180 2024-08-17T02:29:54.489 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-08-17T02:29:54.489 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3645139242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3645139242},{"type":"v1","addr":"172.21.15.146:6837","nonce":3645139242}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4927,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/2100420773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2100420773},{"type":"v1","addr":"172.21.15.150:6834","nonce":2100420773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1907611855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":1907611855},{"type":"v1","addr":"172.21.15.150:6835","nonce":1907611855}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/142672190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":142672190},{"type":"v1","addr":"172.21.15.146:6835","nonce":142672190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:29:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 25 2024-08-17T02:29:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.489+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 msgr2=0x7f9eec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.489+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 0x7f9eec067600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9efc034000 tx=0x7f9efc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.489+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 msgr2=0x7f9f0c166dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.489+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c5b0 tx=0x7f9ef8007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:54.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 shutdown_connections 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:6832/36852,v1:172.21.15.146:6833/36852] conn(0x7f9eec065150 0x7f9eec067600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c155180 0x7f9f0c166dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f0c155550 0x7f9f0c167300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 --2- 172.21.15.146:0/3757089625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9f0c06e080 0x7f9f0c069130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 >> 172.21.15.146:0/3757089625 conn(0x7f9f0c0cb9b0 msgr2=0x7f9f0c1510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 shutdown_connections 2024-08-17T02:29:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-08-17T02:29:54.490+0000 7f9f11e00640 1 -- 172.21.15.146:0/3757089625 wait complete. 2024-08-17T02:29:54.506 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:29:54.506 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:29:54.506 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:29:54.507 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.520 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:29:54.521 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:29:54.521 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.575 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:29:54.575 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:29:54.575 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.591 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:29:54.591 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:29:54.591 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.648 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:29:54.648 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:29:54.648 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:29:54.648 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.694 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:29:54.694 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:29:54.695 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.752 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:29:54.752 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:29:54.752 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.804 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:29:54.804 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:29:54.804 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.856 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:29:54.856 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:29:54.856 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.894 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:29:54.894 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:29:54.894 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:54.982 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:29:54.982 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:29:54.982 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:57.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-08-17T02:29:59.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:59.867 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:01.084 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:30:01.085 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:30:01.085 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.125 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:30:01.125 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:30:01.125 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:30:01.126 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.191 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:30:01.192 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:30:01.192 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.251 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:30:01.251 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:30:01.252 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:30:01.252 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.272 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:30:01.273 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:30:01.273 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.291 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:30:01.291 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:30:01.292 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:30:01.350 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:30:01.350 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:30:01.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:30:01.434 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:30:01.434 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:30:01.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:30:01.577 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:30:01.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:30:01.747 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:30:01.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:30:01.846 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:30:01.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:30:01.958 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:30:02.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:30:02.142 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:30:02.250 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:30:02.251 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:30:02.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-08-17T02:30:02.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:30:02.358 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:30:02.459 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:30:02.460 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/data/mon.a.tgz 2024-08-17T02:30:02.460 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-08-17T02:30:02.496 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.RcK9YJPttg 2024-08-17T02:30:02.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RcK9YJPttg 2024-08-17T02:30:02.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.RcK9YJPttg 2024-08-17T02:30:02.773 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.RcK9YJPttg is 314KB 2024-08-17T02:30:02.862 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.RcK9YJPttg 2024-08-17T02:30:02.897 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/data/mon.b.tgz 2024-08-17T02:30:02.897 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-08-17T02:30:02.934 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.NgyVZBGgrx 2024-08-17T02:30:02.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NgyVZBGgrx 2024-08-17T02:30:03.127 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.NgyVZBGgrx 2024-08-17T02:30:03.221 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.NgyVZBGgrx is 413KB 2024-08-17T02:30:03.311 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.NgyVZBGgrx 2024-08-17T02:30:03.346 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/data/mon.c.tgz 2024-08-17T02:30:03.346 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-08-17T02:30:03.421 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.3CcPz1YK6K 2024-08-17T02:30:03.422 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3CcPz1YK6K 2024-08-17T02:30:03.604 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.3CcPz1YK6K 2024-08-17T02:30:03.698 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.3CcPz1YK6K is 413KB 2024-08-17T02:30:03.787 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.3CcPz1YK6K 2024-08-17T02:30:03.822 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:30:03.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:03.827 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:30:03.918 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:30:03.919 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:03.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:30:03.984 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:03.984 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:30:03.995 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:30:03.997 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi146/crash 2024-08-17T02:30:03.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:04.052 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi150/crash 2024-08-17T02:30:04.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:30:04.108 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:30:04.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:04.112 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:04.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:04.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:04.306 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:30:04.306 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:04.310 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:30:04.360 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2024-08-17T02:30:04.361 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2024-08-17T02:30:04.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2024-08-17T02:30:04.362 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2024-08-17T02:30:04.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46479.log 2024-08-17T02:30:04.363 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2024-08-17T02:30:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2024-08-17T02:30:04.364 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2024-08-17T02:30:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2024-08-17T02:30:04.365 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46479.log.gz 2024-08-17T02:30:04.367 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-08-17T02:30:04.367 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:04.368 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43111.log 2024-08-17T02:30:04.368 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51549.log 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2024-08-17T02:30:04.369 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2024-08-17T02:30:04.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-08-17T02:30:04.373 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51549.log.gz 2024-08-17T02:30:04.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 89.2% 2024-08-17T02:30:04.373 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50143.log 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48988.log 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47994.log 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50143.log.gz 2024-08-17T02:30:04.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2024-08-17T02:30:04.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:04.375 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43111.log.gz 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42386.log 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:30:04.376 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.42386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42386.log.gz 2024-08-17T02:30:04.377 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37401.log 2024-08-17T02:30:04.377 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:30:04.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37401.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37401.log.gz 2024-08-17T02:30:04.378 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:30:04.378 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37361.log 2024-08-17T02:30:04.381 INFO:teuthology.orchestra.run.smithi146.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.48988.log.gz 2024-08-17T02:30:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44398.log 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47994.log.gz 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46059.log 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44398.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44398.log.gz 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45451.log 2024-08-17T02:30:04.382 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46059.log.gz 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42548.log 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.2.45451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45451.log.gz 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45975.log 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42548.log.gz 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50437.log 2024-08-17T02:30:04.383 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2024-08-17T02:30:04.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2024-08-17T02:30:04.384 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45975.log.gz 2024-08-17T02:30:04.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50437.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50437.log.gz -5 2024-08-17T02:30:04.384 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51507.log 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37361.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37361.log.gz/var/log/ceph/ceph-osd.6.log: 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37150.log 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42707.log 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37150.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37150.log.gz 2024-08-17T02:30:04.387 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-08-17T02:30:04.388 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.3.42707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42707.log.gz 2024-08-17T02:30:04.389 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51507.log.gz 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-08-17T02:30:04.390 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2024-08-17T02:30:04.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz 2024-08-17T02:30:04.392 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-08-17T02:30:04.395 INFO:teuthology.orchestra.run.smithi150.stderr: 92.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37321.log 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37441.log 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37321.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37321.log.gz 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37441.log.gz 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:30:04.396 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.37190.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-08-17T02:30:04.399 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:30:04.399 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:30:04.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47952.log 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46739.log 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-08-17T02:30:04.400 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47952.log.gz 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49284.log 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46739.log.gz 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45537.log 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49284.log.gz 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2024-08-17T02:30:04.401 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43441.log 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45537.log.gz 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44746.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43441.log.gz 2024-08-17T02:30:04.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-08-17T02:30:04.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45681.log: 88.3%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:30:04.404 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37234.log 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43106.log 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37234.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37234.log.gz 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43106.log.gz 2024-08-17T02:30:04.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49368.log 2024-08-17T02:30:04.406 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-08-17T02:30:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-08-17T02:30:04.407 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2024-08-17T02:30:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49368.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49368.log.gz 2024-08-17T02:30:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2024-08-17T02:30:04.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-08-17T02:30:04.408 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-08-17T02:30:04.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48816.log 2024-08-17T02:30:04.409 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2024-08-17T02:30:04.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2024-08-17T02:30:04.410 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-08-17T02:30:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48816.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48816.log.gz 2024-08-17T02:30:04.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47478.log 2024-08-17T02:30:04.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-08-17T02:30:04.411 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2024-08-17T02:30:04.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2024-08-17T02:30:04.412 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47478.log.gz 2024-08-17T02:30:04.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51423.log 2024-08-17T02:30:04.413 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-08-17T02:30:04.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46143.log 2024-08-17T02:30:04.413 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz 2024-08-17T02:30:04.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48290.log 2024-08-17T02:30:04.414 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51423.log.gz 2024-08-17T02:30:04.415 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2024-08-17T02:30:04.415 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46143.log.gz 2024-08-17T02:30:04.416 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50679.log 2024-08-17T02:30:04.416 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48290.log.gz 2024-08-17T02:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43978.log 2024-08-17T02:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz 2024-08-17T02:30:04.417 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-08-17T02:30:04.418 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50679.log.gz 2024-08-17T02:30:04.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45621.log 2024-08-17T02:30:04.419 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43978.log.gz 2024-08-17T02:30:04.419 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42718.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:30:04.419 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-08-17T02:30:04.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45621.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45621.log.gz -5 --verbose 2024-08-17T02:30:04.420 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.42200.log 2024-08-17T02:30:04.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46311.log 2024-08-17T02:30:04.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46960.log 2024-08-17T02:30:04.422 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-08-17T02:30:04.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49494.log 2024-08-17T02:30:04.423 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46311.log.gz 2024-08-17T02:30:04.424 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46960.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46960.log.gz 2024-08-17T02:30:04.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46823.log 2024-08-17T02:30:04.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2024-08-17T02:30:04.425 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49494.log.gz 2024-08-17T02:30:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46823.log.gz 2024-08-17T02:30:04.426 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51210.log 2024-08-17T02:30:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2024-08-17T02:30:04.427 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2024-08-17T02:30:04.428 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51210.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.44482.log -- replaced with /var/log/ceph/ceph-client.admin.51210.log.gz 2024-08-17T02:30:04.428 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:30:04.429 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2024-08-17T02:30:04.429 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2024-08-17T02:30:04.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44482.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:30:04.430 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-08-17T02:30:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45087.log 2024-08-17T02:30:04.431 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2024-08-17T02:30:04.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49200.log 2024-08-17T02:30:04.433 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.45087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45087.log.gz 2024-08-17T02:30:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43781.log 2024-08-17T02:30:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2024-08-17T02:30:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49200.log: /var/log/ceph/ceph-client.admin.43781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49200.log.gz 2024-08-17T02:30:04.436 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43781.log.gz 2024-08-17T02:30:04.436 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2024-08-17T02:30:04.436 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:30:04.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50185.log: /var/log/ceph/ceph-client.admin.44020.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2024-08-17T02:30:04.438 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gz 2024-08-17T02:30:04.438 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43098.log 2024-08-17T02:30:04.439 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:30:04.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43098.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43098.log.gz 2024-08-17T02:30:04.440 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2024-08-17T02:30:04.441 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2024-08-17T02:30:04.442 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48038.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30783.log 2024-08-17T02:30:04.442 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2024-08-17T02:30:04.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49452.log 2024-08-17T02:30:04.444 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2024-08-17T02:30:04.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.tmp-client.admin.30783.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30783.log.gz 2024-08-17T02:30:04.445 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-08-17T02:30:04.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49452.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49452.log.gz 2024-08-17T02:30:04.446 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-08-17T02:30:04.447 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42016.log 2024-08-17T02:30:04.448 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-08-17T02:30:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42886.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2024-08-17T02:30:04.449 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-08-17T02:30:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42016.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:30:04.450 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42016.log.gz 2024-08-17T02:30:04.450 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:30:04.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48774.log 2024-08-17T02:30:04.451 INFO:teuthology.orchestra.run.smithi146.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2024-08-17T02:30:04.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2024-08-17T02:30:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48946.log 2024-08-17T02:30:04.454 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48774.log.gz 2024-08-17T02:30:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47520.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2024-08-17T02:30:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-08-17T02:30:04.456 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48946.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48946.log.gz 2024-08-17T02:30:04.456 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51631.log 2024-08-17T02:30:04.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-08-17T02:30:04.458 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gz 2024-08-17T02:30:04.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51631.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51631.log.gz 2024-08-17T02:30:04.460 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:30:04.461 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43110.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-08-17T02:30:04.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42097.log 2024-08-17T02:30:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44062.log 2024-08-17T02:30:04.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42097.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42097.log.gz 2024-08-17T02:30:04.463 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2024-08-17T02:30:04.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50353.log 2024-08-17T02:30:04.465 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44062.log.gz 2024-08-17T02:30:04.466 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42590.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2024-08-17T02:30:04.467 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49242.log 2024-08-17T02:30:04.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50353.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50353.log.gz 2024-08-17T02:30:04.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45723.log 2024-08-17T02:30:04.469 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44272.log 2024-08-17T02:30:04.469 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49242.log.gz 2024-08-17T02:30:04.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-08-17T02:30:04.471 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45723.log.gz 2024-08-17T02:30:04.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47860.log 2024-08-17T02:30:04.472 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44272.log.gz 2024-08-17T02:30:04.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50017.log 2024-08-17T02:30:04.473 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-08-17T02:30:04.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50059.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47860.log.gz 2024-08-17T02:30:04.475 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:30:04.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50017.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43442.log 2024-08-17T02:30:04.476 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50017.log.gz 2024-08-17T02:30:04.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2024-08-17T02:30:04.478 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50059.log.gz 2024-08-17T02:30:04.479 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50721.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43442.log.gz 2024-08-17T02:30:04.479 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:30:04.480 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49933.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2024-08-17T02:30:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:30:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42368.log 2024-08-17T02:30:04.483 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-08-17T02:30:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-08-17T02:30:04.484 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42368.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42368.log.gz 2024-08-17T02:30:04.485 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50595.log 2024-08-17T02:30:04.485 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42634.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-08-17T02:30:04.487 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50595.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50595.log.gz 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50395.log 2024-08-17T02:30:04.489 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47002.log 2024-08-17T02:30:04.490 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50395.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50395.log.gz 2024-08-17T02:30:04.492 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47002.log.gz 2024-08-17T02:30:04.492 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46269.log 2024-08-17T02:30:04.494 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2024-08-17T02:30:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46269.log.gz 2024-08-17T02:30:04.496 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43779.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2024-08-17T02:30:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48648.log 2024-08-17T02:30:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2024-08-17T02:30:04.499 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48648.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48648.log.gz 2024-08-17T02:30:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2024-08-17T02:30:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51118.log 2024-08-17T02:30:04.503 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2024-08-17T02:30:04.504 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51118.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51118.log.gz 2024-08-17T02:30:04.505 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47646.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2024-08-17T02:30:04.506 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46866.log 2024-08-17T02:30:04.507 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51033.log 2024-08-17T02:30:04.508 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46866.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46866.log.gz 2024-08-17T02:30:04.509 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 91.6% --verbose -- replaced with /var/log/ceph/ceph-mgr.y.log.gz -- 2024-08-17T02:30:04.509 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.46613.log 2024-08-17T02:30:04.509 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51033.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51033.log.gz 2024-08-17T02:30:04.510 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2024-08-17T02:30:04.511 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45579.log 2024-08-17T02:30:04.511 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz 2024-08-17T02:30:04.513 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46781.log 2024-08-17T02:30:04.513 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2024-08-17T02:30:04.514 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45579.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45579.log.gz 2024-08-17T02:30:04.514 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2024-08-17T02:30:04.515 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46781.log.gz 2024-08-17T02:30:04.516 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45807.log 2024-08-17T02:30:04.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2024-08-17T02:30:04.517 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2024-08-17T02:30:04.518 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45849.log 2024-08-17T02:30:04.518 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45807.log.gz 2024-08-17T02:30:04.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48732.log 2024-08-17T02:30:04.520 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2024-08-17T02:30:04.521 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2024-08-17T02:30:04.521 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45849.log.gz 2024-08-17T02:30:04.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50227.log 2024-08-17T02:30:04.522 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48732.log.gz 2024-08-17T02:30:04.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49410.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2024-08-17T02:30:04.524 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-08-17T02:30:04.524 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50227.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50227.log.gz 2024-08-17T02:30:04.525 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-08-17T02:30:04.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46395.log 2024-08-17T02:30:04.527 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-08-17T02:30:04.528 INFO:teuthology.orchestra.run.smithi150.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:30:04.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43782.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-08-17T02:30:04.528 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2024-08-17T02:30:04.529 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46395.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46395.log.gz 2024-08-17T02:30:04.530 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45151.log 2024-08-17T02:30:04.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43103.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2024-08-17T02:30:04.531 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46227.log 2024-08-17T02:30:04.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2024-08-17T02:30:04.533 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45151.log.gz 2024-08-17T02:30:04.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46227.log.gz 2024-08-17T02:30:04.534 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48332.log 2024-08-17T02:30:04.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46017.log 2024-08-17T02:30:04.536 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz 2024-08-17T02:30:04.536 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:30:04.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-08-17T02:30:04.537 INFO:teuthology.orchestra.run.smithi146.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48332.log.gz 2024-08-17T02:30:04.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46017.log: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:30:04.538 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46017.log.gz 2024-08-17T02:30:04.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50637.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-08-17T02:30:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51589.log 2024-08-17T02:30:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2024-08-17T02:30:04.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43099.log 2024-08-17T02:30:04.542 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51589.log.gz 2024-08-17T02:30:04.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48862.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2024-08-17T02:30:04.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-08-17T02:30:04.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42456.log 2024-08-17T02:30:04.544 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43099.log.gz 2024-08-17T02:30:04.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-08-17T02:30:04.546 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-08-17T02:30:04.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42456.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42456.log.gz 2024-08-17T02:30:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2024-08-17T02:30:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43108.log 2024-08-17T02:30:04.548 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2024-08-17T02:30:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50931.log 2024-08-17T02:30:04.549 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2024-08-17T02:30:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43773.log 2024-08-17T02:30:04.550 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43108.log.gz 2024-08-17T02:30:04.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50931.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50931.log.gz 2024-08-17T02:30:04.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46437.log 2024-08-17T02:30:04.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45891.log 2024-08-17T02:30:04.553 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43773.log.gz 2024-08-17T02:30:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2024-08-17T02:30:04.554 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46437.log.gz 2024-08-17T02:30:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45891.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45891.log.gz 2024-08-17T02:30:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51465.log 2024-08-17T02:30:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50847.log 2024-08-17T02:30:04.556 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2024-08-17T02:30:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-08-17T02:30:04.557 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51465.log.gz 2024-08-17T02:30:04.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-08-17T02:30:04.559 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50847.log.gz 2024-08-17T02:30:04.559 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47351.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2024-08-17T02:30:04.559 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-08-17T02:30:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-08-17T02:30:04.561 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-08-17T02:30:04.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51076.log 2024-08-17T02:30:04.562 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-08-17T02:30:04.563 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44188.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47604.log 2024-08-17T02:30:04.563 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-08-17T02:30:04.564 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:30:04.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2024-08-17T02:30:04.565 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51076.log.gz 2024-08-17T02:30:04.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47604.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:30:04.565 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47604.log.gz 2024-08-17T02:30:04.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-08-17T02:30:04.567 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2024-08-17T02:30:04.568 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2024-08-17T02:30:04.569 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37118.log 2024-08-17T02:30:04.569 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-08-17T02:30:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47435.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2024-08-17T02:30:04.571 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2024-08-17T02:30:04.572 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37118.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2024-08-17T02:30:04.572 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:30:04.573 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50973.log 2024-08-17T02:30:04.573 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2024-08-17T02:30:04.574 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50311.log 2024-08-17T02:30:04.575 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2024-08-17T02:30:04.576 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42242.log 2024-08-17T02:30:04.576 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50973.log.gz 2024-08-17T02:30:04.577 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50311.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50311.log.gz 2024-08-17T02:30:04.577 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-08-17T02:30:04.579 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2024-08-17T02:30:04.579 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42242.log.gz 2024-08-17T02:30:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43769.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-08-17T02:30:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46912.log: -- /var/log/ceph/ceph-client.admin.45765.log 2024-08-17T02:30:04.581 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2024-08-17T02:30:04.582 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43433.log 2024-08-17T02:30:04.584 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2024-08-17T02:30:04.584 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45765.log.gz 2024-08-17T02:30:04.585 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43433.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43433.log.gz 2024-08-17T02:30:04.586 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.49807.log: --verbose -- /var/log/ceph/ceph-client.admin.41828.log 2024-08-17T02:30:04.586 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2024-08-17T02:30:04.587 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2024-08-17T02:30:04.588 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-08-17T02:30:04.589 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41828.log.gz 2024-08-17T02:30:04.589 INFO:teuthology.orchestra.run.smithi150.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:30:04.590 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45933.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2024-08-17T02:30:04.590 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.47730.log 2024-08-17T02:30:04.591 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49578.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-08-17T02:30:04.591 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2024-08-17T02:30:04.593 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50889.log 2024-08-17T02:30:04.593 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47730.log.gz 2024-08-17T02:30:04.594 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47190.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-08-17T02:30:04.595 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43778.log 2024-08-17T02:30:04.596 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50889.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50889.log.gz 2024-08-17T02:30:04.596 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48603.log 2024-08-17T02:30:04.597 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43778.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43778.log.gz 2024-08-17T02:30:04.597 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-08-17T02:30:04.598 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.48603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48603.log.gz 2024-08-17T02:30:04.599 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42506.log 2024-08-17T02:30:04.600 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-08-17T02:30:04.600 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-08-17T02:30:04.601 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49662.log 2024-08-17T02:30:04.601 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42506.log.gz 2024-08-17T02:30:04.602 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51296.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-08-17T02:30:04.603 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46655.log 2024-08-17T02:30:04.604 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49662.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49662.log.gz 2024-08-17T02:30:04.604 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48690.log 2024-08-17T02:30:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2024-08-17T02:30:04.606 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46655.log.gz 2024-08-17T02:30:04.607 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48690.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48690.log.gz 2024-08-17T02:30:04.607 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2024-08-17T02:30:04.608 INFO:teuthology.orchestra.run.smithi146.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:30:04.609 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-08-17T02:30:04.609 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2024-08-17T02:30:04.610 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47772.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2024-08-17T02:30:04.610 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47910.log 2024-08-17T02:30:04.611 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51339.log 2024-08-17T02:30:04.611 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-08-17T02:30:04.612 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2024-08-17T02:30:04.612 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47910.log.gz 2024-08-17T02:30:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.51339.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51339.log.gz 2024-08-17T02:30:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-08-17T02:30:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.49158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2024-08-17T02:30:04.615 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2024-08-17T02:30:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50101.log 2024-08-17T02:30:04.616 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gz 2024-08-17T02:30:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42760.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2024-08-17T02:30:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.50101.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50101.log.gz 2024-08-17T02:30:04.628 INFO:teuthology.orchestra.run.smithi150.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:30:04.631 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-08-17T02:30:04.631 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m0.287s 2024-08-17T02:30:04.631 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m0.988s 2024-08-17T02:30:04.631 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.169s 2024-08-17T02:30:04.641 INFO:teuthology.orchestra.run.smithi146.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:30:04.657 INFO:teuthology.orchestra.run.smithi146.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:30:04.671 INFO:teuthology.orchestra.run.smithi146.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:30:04.758 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:30:04.761 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-08-17T02:30:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m0.422s 2024-08-17T02:30:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m1.188s 2024-08-17T02:30:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.637s 2024-08-17T02:30:04.763 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:30:04.763 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi146/log 2024-08-17T02:30:04.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:05.119 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi150/log 2024-08-17T02:30:05.123 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:30:05.303 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:30:05.314 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:30:05.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:05.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:30:05.439 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:30:05.447 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:30:05.448 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:05.452 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:30:05.481 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:30:05.485 INFO:teuthology.orchestra.run.smithi150.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 -47us[ -37us] +/- 59ms 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -62us[ -62us] +/- 61ms 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +182us[ +191us] +/- 61ms 2024-08-17T02:30:05.489 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:30:05.492 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:30:05.492 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-08-17T02:30:05.492 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -29us[+5104ns] +/- 59ms 2024-08-17T02:30:05.492 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -43us[ -43us] +/- 61ms 2024-08-17T02:30:05.493 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +193us[ +193us] +/- 61ms 2024-08-17T02:30:05.493 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:30:05.494 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:30:05.504 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:30:05.504 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:30:05.585 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:30:05.703 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:30:05.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:30:05.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:05.878 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:30:05.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:05.938 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:30:05.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:30:05.961 INFO:teuthology.task.internal:Duration was 748.883679 seconds 2024-08-17T02:30:05.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:30:05.976 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:30:05.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:05.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:30:06.064 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:30:06.068 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:30:06.583 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:30:06.584 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-08-17T02:30:06.584 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:06.633 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-08-17T02:30:06.633 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:30:06.691 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:30:06.691 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:06.695 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:30:06.754 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:30:06.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:06.759 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:30:06.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:30:06.911 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:30:06.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:06.967 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:30:07.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:30:07.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:07.040 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:07.107 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-08-17T02:30:07.110 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-08-17T02:30:07.141 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:07.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:07.174 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:30:07.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:07.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:30:07.218 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:30:07.219 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi146 2024-08-17T02:30:07.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:07.284 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858276/remote/smithi150 2024-08-17T02:30:07.284 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:30:07.347 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:30:07.347 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:07.352 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:30:07.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:30:07.397 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:30:07.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:30:07.461 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:30:07.462 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:07.466 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:30:07.497 INFO:teuthology.orchestra.run.smithi146.stdout: 395200 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:07.501 INFO:teuthology.orchestra.run.smithi150.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:30 /home/ubuntu/cephtest 2024-08-17T02:30:07.503 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:30:07.514 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:30:07.578 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 748.8836789131165 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ea7c67fb8f6343c3a7f3aec91c0349c5 status: fail success: false 2024-08-17T02:30:07.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:30:07.661 INFO:teuthology.run:FAIL